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ABSTRACT 

This aanual i-s designed to aid the, user inVjeasuring 
consumer satisfaction vith^ vocational rehabilitation se;:vices. The 
manual contains materials which were used by the West Virginia 
Research and Training Center in a followup study,. Step-by-step 
guidelines are provided fpr aitsessing the effectiveness of vocational 
rehabilitation services by surveying clients and their employers. 
Topics covered are: planning and conducting the study^ preparing 
survey forms, analyzing data and writing research reports. Included 
in the appendices are employee and employer questionnaires, articles 
on sampling and standard deviation, and an example of a completed 
research report. Since there are many aspects of followup studies 
which are not covered here, manual users can use the materials as a 
guide to construct their own questionnaires. The manual is geared for 
those having little or no experience in conducting followup research. 
(Author/SJL) 
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FOREWORD 



Is vocational rehabilitation doing any good? What good occurred as a result 
of vocational rehabilitation services? What would have happened if no vocational 
rehabilitation services were provided? Measurement of the effectiveness of voca- 
tional rehabilitation services should provide answers to these three questions. 
This manual will not tell you how to secure the answers to these three questions. 
It will, however, assist you in making an appropriate first step by measuring con- 
sumer satisfaction with vocational rehabilitation services. A word af caution: 
While the presence of negative consumer attitudes toward vocational rehabilitation 
services can be considejed significant, the absence of negative findings does not in 
and of Itself constitute evidence that vocational rehabilitation services had 9 posi- 
tive effect. 

When we talk about measuring consumer satisfaction, obviously we are 
talking about the client who has received services from the state vocational reha- 
bilitation agency. But is the client the only consumer? What about the client's 
employer? Is he not also a consumer? Doesn't the employer "consume" and 
pay for the services of the client? The extent to which an employer is satisfied 
with an individual's job performance is an indication of that individual's ability 
to be productive and self-sufficient.. So even though it is the client who receives 
vocational rehabilitation services, both the client and his employer are affected 
by these services. Broadly speaking then, both are consumers. 

This manual contains materials which were used by the West Virginia Re- 
search and Training Center in a fc5llow-ap study. It will provide you with a basic 
guide to a first step in assessing the effectiveness of VR services through a follow- 
up study of both the client and his employer. Since there are many aspects of 
follow up which are not covered here, manual users should (1) add items to 
answer their specific needs, (2) use the materials as a guide to construct their 
own questionnaire, or (3) omit items which are not pertinent to their surveys. . 

The information in this manual is geared for those who have had little or 
no experience in conducting a follow-up study. Sections I, II and III contain ^ 
two questionnaires and provide guidelines for their use. Section V is ^ guide 
for recording the data. Experienced evaluators can simply refer to Section II 
and Appendices A, B and C. 
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SECTION I 
Planning and (Conducting Your Study 

A. Design of the Study 

Thorough planning for yoiir study is one of the most important steps m the whole 
process. You must take time at the beginning to think through just exactly what it is 
you want to do and why. It involves making decisions about why you wanj to do a 
study, who you want to study, and what you want to learn from them. Som6 of the 
questions you must answer are: 

1. What are the goals of the study? In other words, why are you planning to 
do a follow-up study and what do you plan to do with the findings of your 
study? In most instances the reason for doing the study is to bring about 
changes in your agency program in order to provide better services to your 
client. If program change is one of the goals of your study, it would be a 
wise move to involve in the development of the study those groups who 
might become targets of the change, e.g., rehabilitation counselors, district 
supervisors, clients. j 

2. Who do you want to study? There are several options open to younn this 
area. You may want to look at all closed cases during a particular ^time 
period, that is, closed in Statuses 08, 26, 28 and 30. Or you may decide 
that you just want to look at one or two of the closure statuses. If, for 
instance, you decide to look at all clients closed in Statuses 08 and 26, 
this provides you the opportunity of looking for similarities and differ- 
ences between the two groups of clients. The same would hold true for 
examining cases closed in Statuses 28 and 30, compared to Status 26. 
The follow-up study that was conducted by the West Virginia Research 
and Training Center involved only clients who had been closed in Status 
26. It is our recommendation, however, that you exanriine a wider spec- 
trum of clients from your own agency. 

3. What time period should I use for selecting clients? You could of course 
select any time period which seems appropriate for your purposes. We 

- would suggest that you use cases that have been closed at least one year 
in order to get some measure of the lasting impact of vocational rehabil- 
itation services on the client. You could decide for instance that you 
wanted to look at all cases closed during the preceeding fiscal year, all 
cases closed during a six month or even a three month period. 
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4. Do I need to sample? Whether or not you need to sample depends upon 
the group you have decided to study. If the number of clients involved 

IS not too extensive, you may want to survey all the clients. For example, 
if you are looking at all the clients closed 26 during a three month period, 
you may wish to look at every case. However, if you are looking at all 
the clients closed during the fiscal year, the number may be so large that 
you would want to sample. The amount of time that you have available 
in which to conduct the study and the amount of resources, i.e., staff and 
money, would also play a part in your decision to sample or to look at 
every case in the study. 

5. How shall I collect my data? The two most common methods of collecting : 
information of this type are through the use of mailed questionnaires and 

by interviews. Here again the amount of staff and money that you have 
available to you will determine whether or not you would use the mail or 
interview route. The use of mailed questionnaires is the most inexpensive 
method of data collection, but is not always the most effective. Normally 
with rehabilitation clients the percentage of return on mailed questionnaires 
IS quite low. Interviewing is a much more expensive technique, but if this 
is your first follow-up study you might want to consider doing so. It might 
be possible for you to use students or case aides to do the interviewing 
which would considerably reduce the expense to the agency. 

If you have decided that you are going to sample from your total population, 
then move on to the next section on sample selection. If you have decided that you 
are going to try to study each case, then skip Section B and move to Section C - 
Gathering the Information. 

B. Sample Selection 

You have decided to sample and you know what your population is, that is, 
what statuses you are going rd look at during what time period. You now must 
decide on the type of sampling that you want to do. For those of you who are 
unfamiliar with sampling techniques, refer to Appendix D for information on 
sampling procedures. On the basis of this information you will probably be 
either selecting your cases by random sampling techniques or through the use of 
stratified random sampling. For either type of sampling, the first step that you 
must take is to collect the names of all the clients who were closed in the appro- 
priate statuses during the selected time period. Then assign each a number and 
proceed to select your sample in accordance with the directions in Appendix D. 

Now that you have the* names of those persons that you are going to seek 
information from, you are ready to proceed to gather your information. 
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C. Gathering the Information 

If you are going to use mailed questionnaires, a copy of the employee question- 
naire should be mailed to all former VR clients who are to be surveyed. The employ- 
er questionnaire can be mailed to their employers once you receive the client's 
questionnaire back indicating that they are employed and where. For best results, 
a stamped, self-addressed envelope should be included.- This way former clients 
and employers need only complete the forms and place them in the return envel- 
opes. The number of questionnaires returned will vary. If the clients are nearby, a 
phone call to non-respondents would help. 

One method of increasing the number of forms returned is to send the client 
a letter saying jj^t they will receive some reward, say $1.00, when the form is re- 
turned. However, if you cannot pay the client send the form any way. Your rate 
of return on the questionnaires may be small, i.e., 30 - 40%. But a small return is 
better than none. Remember that if your return is less than 70 to 80% your results 
will be somewhat limited. You will not be able to determine the characteristics of 
those former clients who did not return the form. But a limited follow-up study 
is better than none and should provide you with good indications of consumer 
satisfaction. 

In our study we found that employers were more likely to respond using the 
mailed questionnaire than were former clients. For cases closed in Status 26 you 
could use the employer's questionnaire even if you did not get a response from 
the client. It would be interesting to compare employer responses for clients who 
responded to the questionnaire compared to clients who did not respond. You 
might feel that employer responses regarding those clients who did not return 
their form would be less positive than employer responses regarding those clients 
who did return their forms. 

As indicated previously, in studies where interviews would be used for col- 
lecting the data, consideration should be giv6n to students or case aides for data 
collection. All interviewers should be trained in the use of the questionnaire. If 
you do not have someone on your staff who has had experience in this area you 
probably can locate someone in your community who would be willing to give 
a brief training, course in interviewing techniques. 

The primary problem that is faced in gathering information is locating the 
former clients. This is a problem in any type of a research study where you are 
trying to locate people. Here is one area where the use of interviewers for the 
study pays off because they can spend more time tracking down clients who 
have moved, while mailed questionnaires will simply be returned by the post 
office. Locating clients will require diligent perseverance in tracking down 
leads and the rehabilitation counselor who served the client originally could 
be quite helpful in providing leads as to possible whereabouts of missing clients. 
If you are creative you will be successful in locating most of the clients in your 
study. 
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Survey Forms 

There are two forms: one for the former VR client (see Appendix A) and 
one for his employer (see Appendix B). For those individuals interested in the 
technical aspects of questionnaire construction, this information is presented in 
Appendix C. 

A. Employee Questionnaire 

This form (Appendix A) is to be completed by the former VR client. It 
contains a small "Personal Data" section and 42 items. The 42 items cover 
various factors relating to employment. If the client is unemployed, he would 
complete the first three questions only. 

Table A, below, gives the factor (variable) in the first column and references 
the applicable part of the questionnaire in the second column. For example, the 
employment factor of "work proficiency" is tapped by Items 27-32 on the form. 

Table A 

Factors Tapped by Employee Questionnaire 



Factor 



Age 

Marital Status 
Number of dependents 
Educational Level 
Employment Status 
Satisfaction with VR Services 
Job title 

VR Services in relation to present job 
Length of time holding present job 
Hours of work per vveek 
Enjoyment derived from present job 
.Means of getting a job 
Job satisfaction 
Work personality 
Work proficiency 
Self-acceptance 

Attitude toward work 

Employment status of spouse 
Agreement with spouse on family 
affairs 



Employee Questionnaire 



Personal data section 
Personal data section 
Personal data section 
Personal data section 
Item 1 
Items 2 - 3 
Item 4 
Items 5 - 7 ' 
Item 8 
Item 9 
Item 10 
Item 1 1 

Items 12-15 (Hoppock JS Blank) 
Items 16 -26 (Tseng PQ Scale) 
Items 27-32 (Tseng JP Scale) 
Items 33 - 35 (Semantic Differential 
Scale) 

Items 36 - 38 (Semantic Differential 

. , Scale) 
Items 39-41 
Item 42 
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B. Employef Questionnaire 

This form (Appendix B) is to be completed by employers of former VR clients. 
There are 21 items relating to employment. Table B, below, gives the employment 
factor m the first column and relates it to the applicable part of the questionnaire 
in the second column. All items on the Employer Questionnaire are either similar 
or identical to some of the items on the Employee Questionnaire. This makes it 
possible to compare what the former client says to what the employer says. 

^ Tables 

Factors Tapped by Employer Questionnaire 



Factor 



Employer Questionnaire 



Client's job title 
Hours of client's work per week 
Client's work personality 
Client's work proficiency _ 
Client's overall performance 
I mportance of V R services on 
client's performance 



Item 1 
Item 2 

'items 3-13 (Tseng Scale) 
Items 14-19 (Tseng Scaled 
Item 20 

Item 21 



C. Modification of the Forms * 

Read over the items on the questionnaires and compare them with the factors 
given in Table A. List any additional factors or items you may wish to include in 
your study as well as any item you might want to delete from otjr questionnaire 
because you feel it is not appropriate for your study. We have lasted in Appendix 
E several items you may wish to consider adding to this questionnaire. These 
items deal primarily with relationships between famMy members. Other items 
you might wish to include could be concerning the client's work history since 
closure, his current earnings level, and more information about his reaction to 
the rehabilitation counselor and the rehabilitation process it«elf. 

• 

Appendix F contains a form that was used by the West Virginia Research 
and Training Center in a follow-up study of rehabilitation center cliients. This 
form is included simply to give you an example of a shorter, simpler form that 
could be used to conduct a follow-up study. 
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If you have decided to include additional items on the questionnaire, these 
results can be added to one of the suggested tables in Section III of this manual, 
or you may analyze these items separately in one or more tables as appropriate. 
If you do modify the form by adding or deleting items, remember that the 
technical aspects of the questionnaire construction as reported in Appendix C 
would no longer be valid for any identified scales and subscales you decide to 
modify. 
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SECTION III 
Analyzing Your Data 



Compiling Your Data 

There are two ways you can compile your data: -one is for computer analyses 
and the other is for hand or machine calculations. Tables 1-11 plus Figure 1 pre- 
sented later in this section, will give you a good follow-up study and can be com- 
pleted by hand calculations. Tables 12 and 13' require more complex analyses. . 
Although they can be hand calculated, we recommend that they be done on the 
computer or omitted. Their inclusion invour study would lend considerable 
sophistication to your findings. However, if these analyses are unfamiliar to 
you, simply omit them. 

A. Computer Analyses 

If you are planning to analyze your data using a computer, you will have to 
code the data so they can be placed on computer cards or tapes. A sample 
spread sheet for codjng data is shown in Appendix G. If you are not familiar 
with this procedure,' show your computer programmer your questionnaires and 
ask him to set up your spread sheets for proper coding. Be sure to tell him 
what analyses you will want. For example, in Tables 1-11 which follow, you 
would wantr (1) totals, (2) frequencies, (3) averages, (4) percents and 
15) standard deviations. To complete Tables 12 and 13, you would want cor- 
relational analyses. For Figure 1, you may want to code the data so it can 
be analyzed by t-test or analysis of variance. 

B. Hand Calculations 

If you are hand computing the data, refer to Appendix H. We have 
provided sample forms and instructions which you can use as a guide in 
compiling your information. We recommend doing-only Tables 1-11 when, 
using hand calculations. If you wish to compute the standard deviation for 
Tables 8-11, refer to Appendix I. Record the data for employee responses 
and employer responses on different sets of data collection sheets. After- 
' recording and summarizing your data, refer to Section IV, "Writing Your 
Report"", for a suggested reporting format. 

Summarizing Your Data 

You are now ready to summarize your data through the use of tables. 
This will enable you to better understand the meaning of the information 
collected. In the next section, "Writing Your Report", we suggest one way 
in which you might explain the data in your tables. 

11 
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A. Population and Sample 

In order to know what proportion of your population responded to your 
questionnaire, you should summarize the information. Table 1 below provides 
a suggested breakdown. 

Table 1 

Questionnaire Response by Former Clients and Employers 

Total Closed 26 Closed 08, 28, 30 



Category No, % No. % No. ^ % 

Former Clients 

Total Population 
Total Sample 

Responses 

Unable to locate . . 

Deceased 

No Response 

Employers 

Total Contacted ' - ' ^ 

Responses 
No Response 

B. Client Characteristics 

The first information you would probably be most interested in is the em- 
ployment status of the client. Table 2 summarizes the data from Item 1 of the 
Employee Questionnaire. (Use the appropriate column headings for your study.)' 

Table 2 

Employment Status of Former Clients 



Total Qosed 26 Closed 08, 28, 30 

Category No. % No. % No. 

Unemployed 
Training or Schooling 
Self-employed 
Employed part-time 
Employed full-time 

Total 
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Four other interesting* pieces of information can be obtained very easily. 
They 'are age, education, marital status and number of dependents of ^our former 
clients. TWs information is in the personal data section of the Employe Ques- 
tionnaire. You can summarize the data in a table similar to Table 3A ih order 
to compare employed and unemployed clients by closure status to see ?f there 
are differences between the groups. You might want to exclude those former 
-clients who are currently in training or school from this table or include them 
as a separate group. 
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'Table 3A 
Characteristics of Former Clients by 
Closure Status by Current Employment Status 



■ ' Closed 26 : Closed 08, 28, 30 

Employed Unemployed , Employed Unemployed 
Category No, % No. % No. % No. % 

Age 

15-19 . 

20-29 

30-39 

40-49 

50-59 

60 and over 

Total 

Marital Status 

Single 

Married 

Other 

Total 

No. of Dependents 

None ' 
One 

Two ^ 

Three 

Four or more 
Total 

Education 

Grades 1 - 6 
Grades 7 - 9 
Grades 10-11 

Grade 12 , . 

Over 1 2 years 

Total 
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You could of course have four separate tables for this information or you 
could prepare summary tables for employed and unemployed clients by closure 
status, simitar to Table 3B. Our example is for employed clients. 

Table 3 B 

Characteristics of EmployerfClients 



Closed 26 


Cjosed 08, 28, 30 


Factor No. Clients Avg. 


No. Clients Avg. 


Age 




Education 




No. of Dependents 




C. Client's View of VR Services 





Vocational rehabilitation personnel are always interested in finding out how 
the client views the services he received. Item 2 is designed to answer this ques- 
tion. (Item 3 also has bearing on this issu^for if the client was not satisfied with 
services received, he probably would not want to return for additional help.) 
We feel, however, that Item 2 deserves its own table (Table 4) and will deal with 
Item 3 in the next section. ' 

Table 4 

Client Rating of Vocational Rehabilitation Services 
by Closure Status by Current Employment Status 

Closed 26 - Closed 08, 28, 30 

Employed Unemployed Employed Unemployed 

Rating No % Noi % No. % No. % 



Very poor 
Poor 

Uncertarn 
Good 
Very good 
No Response 

Total 
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For employed clients, Items 5, 6 and 7 indicate hpw much the clients feel that 
VR services assisted them in preparation for employment. Table 5 is one way at 
looking at this information. 



Table 5 



Employed Clients Feedback on VR SgryioBS 
(in percent) 



Question 



Total Closed 26 Closed 08, 28, 30 
Yes No Yes No Yes No 



4Did VR training prepare you 
for your job? (Item 5) 

Were you able to do this type 
of work (present job) before 
you contacted VR? (Item 6) 

Did VR counselors assist you 
in finding your job? (Item 7) 

Do you need additional service 
from the VR counselor? 
(Item 3) 



For purposes of this table, the responses to Item 6 are to be interpreted as 
follows: "able to do this work" and "limited ability to do this work" counts as 
"yes"; "not able to do this work" would be counted as "no", 

D. Employers of V R Clients and Client Occupations 

You can find out what kinds of businesses are hiring former VR cleints 
by tallying the information provided on the Employee Questionnaire in Item 1 
(Naijie of Firm). We are providing you with an example (Table 6) which shows 
businesses that turned up in a Research and Training Center survey. This ex-' 
ample should help you set up your own chart, which will use different businesses 
depending on where your clients are employed. 
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Table 6 
Employers of VR Clients 



No. of No, of 

Clients Clients 
Business Employed Business Employed 



Automobile body shop 
Automobile dealer 
Automotive springs and 

service 
Bank 

Beauty salon 

Can manufacturing 

Church 

Coal mining 

Coffee shop 

College dormitory 

Community action assoc. 

Construction materials 

County Board of Ed. 

Delivery company 

Gas station 

Glass factory 

.Grade school 

Grocery store 

Heating company 



High School 
Hospital and clinic 
Homeowner 
Hotel 

Industrial supplies 

Lumber company 

Metal products 
^■Nursing home 

Optical company 

Power plant 

Realty company 

Restaurant 

Retail store 

Sheltered workshop 

State Department of 
Employment Sec. 

State Dept. of Highways 
, State Police 

Transportation (bus) Co. 

TOTAL 



* Another piece of information which should be useful is the type of job that 
the VR client is employed in. We-suggest a table that shows the occupations of 
the employed clients who returned their questionnaires. This information can . 
be obtained from two sources. The first source is on the Employee*s Question- 
naire, Item 4, The second source {wh\h can serve as a cross check) is on the 
Employer's Questionnaire, ltem.1. A sample chart (Table 7) is shown below 
using occupations four^jl by the R & T Center in one of its surveys. 
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Table 7 

Current Occupations of Former VR Clients 



Occupation N - Occupation 



^uLUiiiuuiit; uuuy ic^aiiiiiaii 


Kitchen lielper 


AutomoDiie lot ooy 


1 ahorpr 


MUio rncvndnic 


Loan officer * 


RahV/Qittpr " 

\JO\Jj 91 L LCI 


Mine foreman .-.^ 


Roai 1 tirian 

DCaULiuiaii - — ' 


Offite helper 




Office supervisor 


Clerk - hotel 


Packer 


Clerk - office 


Practical nurse 


Clerk - stock 


Realtor 


Community action aide 


Seamstress/Tailor 


Computer operator 


Secretary 


Cook 


Service station attendant 


Custodian 


Shoe'machine operator 


Damage appraiser 


Social worker 


Driver - bus 


Stenographer ' , 


Driver = truck 


Teacher - public school 


Furnace installer 


Waitress 


Heavy equipment operator 


Welder 


Hospital (or nurse) aide 


TOTAL 



Items 8 and 9 on the Employee Questionnaire relate to how long the former 
\ client has been working and the number of hours worked per week. These two 
items can be handled in a table format similar to Table 2. 

E. Employer and Client Ratings of Client Work Personality and Proficiency 
Attributes 

The client's Work Personality is covered by Items 16 - 26 on the Employee 
Questionnaire and Items 3 - 13 on ^he Employer Questionnaire. The results for 
each of the 1 1 attributes can be cJaunted ^nd averaged. Then a composite score 
for all rr attributes can be computed by simply adding the averages for the 1 1 
attributes. This ca'n be done for both client and employer responses in one table 
for comparison. (See the first part of Table 8). ^ 
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The client's Proficiency attributes are covered by^'tems (Items 27 • 32 on 
Employee Questionnaire and Items 14^-"19 on Employer Questionnaire). These 
Work Proficiency characteristics can J3e counted and averaged, and then a com- 
posite score for alj 6 attributes can be computed as for the work personality 
items. (See bottom part of Table 8 below). Finally, a composite of Work Per- 
sonality and Proficiency can be computed by adding the composite score for 
Work Personality and the composite score for Work Proficiency. / 

Item 20 on the Employer's form covers overall performance. 

^ For those individuals using a computer, our table also includes space for 
the standard deviation (SD). If averages are hand computed, this can be omitted. 
If you wish to hand compute \he SD, see Appendix 1. 

Table 8 

Employer and Client Ratings of the Clients' Work 
Personality and Proficiency Attributes 



Employers Clients 
Attributes* Avg. ' SD No.** Avg. SD No. 



Ability to work with others 
Punctuality 
Cooperativeness , ^ 
Self-reliance 
Appearance 

Courtesy " 
Motivation ^ 

Reliability ^ - ♦ 

Work tolerance 
Initiative 
Attitude 
'^Work personality"^ composite 
score 

Job knowledge 
Job skill 
Quality of work 
Care of equipment 
Safety practices 
Following shopjrules 
Work proficiency composite 

score ' 

Work personality and profit 
* ciency composite store * . 

Overall performance 

7 ^ 

* Items 16 32 consecutively on Employee form. Items 3-19 consecutive on Employer. 

** Number of responses may vary since some respondents do not complete all items. 

18 
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Another means^f comparison is to graph the averages for the clients' self- 
ratings as opposed to their employers' ratings. This can be done by using the 
averages from Table 8 if all the client forms have a matching employer form. 
If not, then it will be necessary to retabulate the averages using only those 
cases where both the client and the employer forms are available. are in- 
cluding this graph as Figure 1, with actual data obtaine'd from an R ^T survey 
to show you what this chart might look like. ! 

Figure 1 , 
Comp3rison of Employer and Employee Ratings 
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Note: t-tests can be computed to see if there is a significant difference between 
employee and employer averages for each item. 
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F. Job Satisfaction 

Another factor that is of interest to VR personnel is the extent to which 
clients are satisfied in their jobs. Items 12 - 15 on the Employee Questionnaire 
deal with this issue. The average score of clients' job satisfaction on each of the 
4 items can be computed, and then a composite job satisfaction score can be 
secured by adding. We suggest a table similar to Table 9 below. 

Table 9 
Job Satisfaction 



Item No. 



Average 



SD 



No. 



Item 12 (like job) 
Item 13 (satisfied with job) 
Item 14 (changing jobs) 
Item 15 (comparing job satis- 
faction with other people) 

TOTAL SCALE 



As in Table 8, we have noted a column for Standard) Deviation (SD) for those 
who wish to have this information. You can refer to Appendix I for uses and com- 
putational method for the SD. 

G. Self- Acceptance 

Items 33 - 35 of the Employee Questionnaire deal with the degree to which a 
client is self-accepting, using a 7-point scale. We recommend that this data be sum- 
marized in a manner similar to that shown below in Table 10. 

Table 10 

Self-Acceptance of Clients 



Scale 



Average 



SD 



No. 



Sad - happy 
Dissatisfied - satisfied 
Pessimistic - optimistic 

TOTAL SCALE 
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H. Attitude Toward Work 

A client's attitude toward work can indicate the degree to which he is suc- 
cessful on the job. Items 36 - 38 on the Employee Questionnaire tap this factor. 
A simple approach to presenting these data is shown in Table 1 1 . 

"fiblell 
Client's Attitude Toward Work 



Scale Average SD No. 



Bad ^ good 

Unimportant - importcjnt 
Dull - interesting 

TOTAL SCALE 



Tables 9, 10 and 1 1 can be computed separately for clients closed in status 26 

and in Statuses 08, 28 and 30 or you may want to include them in the same taWe. 

ft. 

I. Correlational Analyses 

For those of you using a computer to summarize your data, we would like to 
suggest the following comparisons. These are correlations, using Pearson's Product 
Moment Correlation. (If you are omitting these analyses, skip to Part J of this 
section). 

(ir Correlates of Job Satisfaction . This looks at the composite score for job 
satisfaction and compares.it to a number of other factors. See Table 12 for a 
sample exhibit. (Be sure to ask your programmer which correlations are signifi- 
cant and identity ^hem in your table). 
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Table 12 
Correlates of Job Satisfaction 



Variable Correlatton No. 



Age 

Number of dependents 

Education (grade completed) 

Rating on VR services 

-Length of time holding present job 

Hours per week (work) 

Enjoyment out of job 

Client's rating of work personality 

Client's rating-of work proficiency 

Client's rating of work personality 

and proficiency 
Employer's rating of work personality 
Employer's rating of work proficiency 
Employer's rating of work personality 

and proficiency 
Employer's rating of overall performance 
Self-acceptance 
Attitude toward work 
Agreement with spouse (family affairs) 
Occupational level 



(2) Correlates of Self-Acceptance. Table 13 looks at the total scale score for 
self-acceptance and compares it X6 the same factors as with Job Satisfaction, above. 

Table 13 
Correlates of Self-Acceptance 



Variable Correlation No. 



Age 

Number of dependents 

Education (grade completed) 

Rating of VR services 

Length of time holding present job 

Hours per week (work) 

Enjoyment out of job 

Job satisfaction 

Client's rating of work personality 
Client's rating of work proficiency 
Client's rating of work personality 

and proficiency 
Employer's rating of work personality 
Employer's rating of work proficiency 
Employer'^s rating of work personality 

and proficiency 
Employer's rating of overall performance 
Attitude toward work 
Agreement with spouse (family affairs) 
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(3) Other Correlations, The same kinds of correlations can be done sepa- 
rately for the composite score of Attitude Toward Work, spousal conformity 
and any other factors you wish. 

Other kinds of analyses you may wish to consider are intercorrelations of 
Work Personality, Work Proficiency and Overall Performance; and a 2 x 2 Chi 
Square contingency table of rating of VR services and need for VR services. 

J. Analysis of Items Not Included in Tables 

There are several items on the Employee Questionnaire which we have not 
included'in any table. These are: 

10 - Enjoyment other than money 

1 1 - Means of getting a job 

39 - 41 - Employment status of spouse 

42 - Agreement with spouse on family affairs 

We elected to discuss the results of these items in the narrative part of the 
follow-up report. You ma^include the information in tables under appropriate 
^ sections if you wish. Our rationale for hot putting the findings in a table was 
that these particular items do not fit with the table format of items covering 
similar information. You will note, however, that the items are covered in 
Section IV, "Writing Your Report". , 

K. Reports 

Appendix J contains one report that was made from thesfe data for a pre-, 
sentation. This report will be most helpful to those who are computing t-tests, 
correlations, etc. ^ 

L. "Other Comparisons 

If you have available resources, i.e., time and staff, we suggest that you ^ 
utilize information in the former clients' case record to make additional com-^ 
parisons. This would enable you to look at such things as: 

1. Earnings before and after rehabilitation 

2. Relationship of current job to training received or job objective 
listed in rehabilitation plan 

3. Employment outcomes for selected groups - by disability, 
training areas, facility services, etc. 

Often more than one area can be investigated in one survey. Our point here 
is to give you a few ideas which can help you formulate additional areas for study* 



-23- 



SECTION IV 
Writing Your Report 

The jollownng is a rough guide to give you some ideas about ho\^ you might 
write } our report. Naturally you will have to add interpretations, conclusions 
and recommendations that are appropriate for your data. Were just outlined a 
suggested report to get you started. There is nothing sacred about this format, 
so use, revise, or discard as you see fit. 

A. Introduction 

In this section of your report include any pertinent information about 
your state agency, facility, district, etc. Alsol)e sure to include your reasons 
forjconducting the study and what you intend to do with the findings. 

B. Method 

1. Population and Sample 

Former rehabilitation clients and their employers' were surveyed. Cli- 
ents were drawn from the 



(e.g,, annual listing of closed cases from the state vocational' rehabilitation 
agency, or the listing of closed cases from the state rehabilitation facility, etc.) 

From a total of vocational rehabilitation cases closed in Status (es) 

during the time period from to , 

were randomly selected. (If you used another sampling method, such as strati- 
fied random sampling, be sure to describe the technique ydu used.) Of the 
individuals selected for' the stu dy, questionnaires were com- 
pleted for former clients. Responses were recefived from em- 
ployees. A breakdown of these respondents is shown in Table 1. 

Table 1 

Questionnaire Response by Former Clients and Employers 

Total Closed 26 Closed 08, 28, 30 
Category No. % 'No. % No. % 

Former Clients 
Total Population 
Total Sample 

Responses 
Unable to locate 
Deceased 
No response 

Employers 
Total Contacted 

Responses 
No Response 
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2. Measuring Instruments 

Two guestionn^ires were used. The form for former VR clients is shown 
in Appendix A, and the form for their employers in Appendix B. A descrip- 
tion of questionnaire construction is included in Appendix C, and the factors 
tapped by the questionnaires in Appendix D. (If you wish, you can just copy 
and use Appendices A, B and C of this manual as is, or with your own revis- 
ions. Your Appendix D will be Table A and Table B from Section II of the 

* 

manual or Tables A and B can be included in youf text under this section. 
If you include them here it will require a renumbering of our tables.) 

C. Analysis of Data 

1, Client Characteristics 

Table 2 shows the employment status of former clients, with em- 
ployed full time, employed part time and self employed. 

Table 2 

Employment Status of Former Clients 



Total Closed 26 Closed 08, 28, 30 

Category No. % No. % ' 

Unemployed * ^ / 

Training or Schooling 

Self-employed 

Employed part-time 

Employediull-time 

Total 

' 7^ 

Among the former clients closed in Status 2d[ % are em- 
ployed, compared to % of the ^former clients closed in Statuses 

08, 28 and 30. • , 

Demographic data for the client respondents who are gainfully 

employed are summarized in Table 3. 




■25- 
Table 3B 



/Characteristics of Employed Clients 





Closed 26 


Closed 08, 28, 30 


Factor 


No. Clients Avg, 


No. Clients Avg. 


Age 






E;ducation * 






No. of Dependents 







Among the employed clients closedvfrom Status 26, (accounting 

for %) are married; ( ) %) are single, and 

( %) are separated, divorced or widowed. For those closed in Statuses 

08, 28 and 30, (accounting for %) are married; i ( _%) 

are single, and L ( %) are separated, divorced or v^idowed. (Be 

sVffe to point out in your narrative the similarities and differences between the 
groups, i.e., employed and unemployed, closed Status 26 and closed Statuses 08, 
28 and 30. 

The distributfon of employed former clients in terms of their primary dis-^^ 
abilities is as follows: (This information should be taken from case records 
since it is not available on the forms. Although it is not absolutely necessary 
for your follow-up study, it does give a better picture of the client and we 
recommend its inclusion if at all possible.) 

Visual impairments, accounting for _% 

' Hearing impairments, accounting for % 

(continue your listing of disabilities) 

The VR services rendered to these clients included 

(e.g. counseling, physical restoration and vocational training. 

Again, this information should be taken from the case records and included 
if at all possible.) 

Of the empjoyed clients, (accounting for %] received 

training, with this being further subdivided into those in college ( clients 

at %) and in vocational and technical training programs ( clients at 

%). 
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clients (accounting for %) received physical restoration services; 

clients (accounting for %) raceived medical and surgical 

treatment; _clients ( %) received psychiatric or therapeutic 

treatment; and ( %) received appliances. 

2. Client's View of VR Services ^ 

»* 

Clients were asked to give their opinions about vocational rehabilitation 
'services. They were asked to rate the services on a 5-point scale. The results 
of their ratings are shown in Table 4.^ 

Table 4 

/ 

Client Rating of Vocational Rehabilitation Services 
by Closure Status by Current Employment Status 



Closed 26 Closed 08, 28, 30 

Employed Unemployed Employed Unemployed 
Rating No. % No, % No. % No. 



Very poor 
Poor 

Uncertain 
Good 
Very good 
No Response 

Total 



Of the clients responding, ^ considered VR services good 

and very good. An additional % rated the services as uncertain, poor and 

very poor, % did not respond. From this, it can be concluded that these 

clients viewed VR services as . 



fincliide yourlnterpretive comnrents here, including any differences based on 
closure status or employment status. ) 

Clients were also asked to give their opinions about VR services as having 
to do with meeting their vocational needs. The* employed clients res- 
ponded as shown in Table 5. 
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Table 5 

Employed Clients Feedback on VR Services 
(in percent) 

Total Closed 26 Closed 08,28, 30 
Question " Yes No Yes No Yes N 



Did VR training prepare you 
for your job? (Item 5) 

Were you able to do this type 
of work (present job) before 
you contacted VR? (Item 6) 

Did VR counselors assist you in 
finding your job? (Item 7) 

Do you need additional service 
from the VR counselor? 
(Item 3) 



As Table 5 shows, pf J clients reported that vocational re- 
habilitation prepared them for their jobs, with s_% responding favorably 

and % responding unfavorably. The extent to which VR services 

assisted in preparing them for their present job is further represented by 

% who felt they could do the job before VR services, % felt 

they had limited ability to do the work, and % felt they could not 

have performed their preseat job without VR services clients 

%) did not respond to this question. /Note: Table 5 is a 

and ''no " response tabulation. For Item 6. two choices-ability and limited 
ability to do job-were interpreted as^ "yes" and one choice-unable to do 
job-^^^as interpreted as **no In our narrative, we have spelled out the 
percents for each of the three choices. This should present no problem 
since the data should be compiled using <til three alternatives.) 

As for assistance rendered by VR counselors in job finding, 

( %) felt the counselor had been helpful while ( %) 

responded in the negative. An additional item (Item 1 1 ) on the question- 
naire also focused on this area. In completing the statement, "If at some 

time in the future^you needed to get a job" clients ( %) felt 

that they themselves should find the job; clients ( %) felt 

that the counselor should find the job for them and ( %) felt 

that some other agency should get the job for them. 
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Of the employed clients, ( %) thought they would need 

additional services from the VR counselor. The services most frequently 

given were ( %), ( %) (e.g., training 

(20%). appliances ( 1^0%), etc. These services are listed in Item 3 and can 
simply be counted '^d included here. You might also want to include a 
comparison on Item ^for unemployed clients if there are differences 
between the-groupsj \. 

3. Employment Data— Employers 

Types of businesses and industries represented by employers who 
completed the questionnaire and for whom former VR clients are work- 
ing is shown in Table 6. 

Table 6 
Employers of VR Clients 



No. of No. of 

Clients Clients , 

Business Employed Business Employed 



Automobile body shop 




High school 


Automobile dealer 




Hospital and clinic 


Automotive springs and 




Homeowner 


service 




Hotel 


Bank 




Industrial supplies 


Beauty salon 




Lumber company 


Can manufacturing 




Metal product 


Church 




Nursing home 


CoaJ mining 




Optical company 


Coffee shop 




Power plant 


College dormitory 




Realty company 


Community action assoc. 




Restaurant 


Construction materials 




Retail store 


County Board of Ed, 




Sheltered workshop 


Delivery company 




State Department of 


Gas station 




Employment Sec, 


Glass factory 




State DepLMf Highways 
State Polled 
Transportation (bus) Co, 


Grade school 




Grocery store 




Heating company 




TOTAL 
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Of the total questionnaires returned ( from former VR clients 

and from employers), matched pairs of employed clients 

and their respective employers resulted from the survey. (Note. Matched 
pairs are used later for Figure 1. If you do not include Figure 7, omit this 
paragraph.) 

4. 'Employment Data-Employees 

Of the employed clients who responded to the employee 

questionnaire, (accounting for ^-%)^had full-time jobs, 

(accounting for ^%) worked part-time, and ( %) 

were self-employed. In terms of hours per week, including the time it 

took to go to and from where the former clients worked, clients 

(accounting for %) worked over 40 hours; clients (accounting 

for %) worked from 20 - 40 hours, and clients ( %) 

worked less than 20 hours. (Note: This information is from Item 9 which 
we did put in a table). ^ 

The types of.occupations represented by these clients are shown in 
Table 7. 

Table 7 



Current Occupations of Former VR Clients 



Occupation 



N 



Occupation 



N 



Automobile body repairman 

Automobile lot boy 

Auto mechanic 

Babysitter 

Beautician 

Box boy 

Clerk - hotel 

Clerk - office 

Clerk - stock 

Community action aide 

Computer operator 

Cook 

Custodian 

Damage appraiser 

Driver - bus 

Driver ■ truck 

Furnace installer 

Heavy equipment operator 

Hospital* (or nurse) aide 



Kitchen helper 
Laborer 

Loan officer ^ 

lyUne-foreman 

Officer helper 

OffjcB-^MPervisor 
^Packer \ ^ 
^Practical rfurse 

Realtor 

Seamstress/Tailor 
Secretary 

Service station attendant 
Shoe machine operator 
Social worker 
Stenographer 
Teacher - public school 
Waitress 
Welder. ^ 

>OTAL 
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Among the employed clients (accounting for %) reported 

that they had held the same job over one year; (accounting for %) 

had held their jobs from seven months to one year; ( ^%) had 

held their jobs for from four to six months; and ( %) had^held 

their jobs three months or less. There were clients ( %) who did 

not respond to this question. (Note: This is Item 8 which was not included 
in a table.) 

Of the self-employed clients who responded, they were employed 

as follows: as_:^ , as^ 

' etc. (From Item I and Item 4J 

5. Employer and Client Ratings of Client Work Personality and Proficiency 

Clients' Work Personality ( 1 1 attributes plus the composite score) and 
work performance (6 attributes plus composite score) were evaluated by 
both the clients (No. = ) and their employers (No. = ). 

In addition, the overall performance of the clients was assessed by their 
respective employers. It should be noted that a 5-p6int scale was used, with 
"1" representing the lowest rating and "5" the highest for assessing all of the 
individual attributes. Table 8 summarizes the results. 

Table 8 

Employer and Client Ratings of the Clients? Work ^ 
Personality and Proficiency Attributes 

^ Employers Clients 

Attributes* Avg. SD -No.** Avg. SD No. 

Ability to work with others 

Punctuality 

Cooperativeness 

Self-reliance 

Appearance 

Courtesy 

MotivaticPi 

Reliability 

Work tolerance 

Initiative 

Attitude 

WorK personality composite 
score 

Job knowledge ' 

Job skill . 
Quality of work 

Care of equipment ^ 
Safety practices 
Following shop rules 
Work proficiency composite 
score 

Work personality and profi- 
ciency composite score 
Overall p erformance ^ [ ^ 

♦ Items 16-32 consecutively on Employee form. Items 3-19 consecutive on Employer 
•* Number of responses may vary since some respondents do not complete all items. 



In terms oftf;ie one-item rating on the overall performance of the 
employed former clients, the^mployers showed an average rating of 

. This indicates they were • 

' (e,g,, quite happy about the 

clients* overall performance, moderately happy, unsatisfied, etc., as 
appropriate). 

As to the ratings of individual attributes within both the work person- 
ality and work proficiency areds, the employers gave their employees an 

average rating df on — i , However, 

they" rated at an' average of for (Here 

you may \^ani to group the characteristics rated average and above average 
together, and the below average characteristics separately. This points to 
client strengths and weaknesses as perceived by the employer,) 

In order to graphically compare the ratings of former clients and their 
employers, matched questionnaires were used. Only those forms in which 
both the client and his employer responded were averaged. Figure 1 shows 
these averages, with one line for the employer and one for the former VR 
client. 

Figure 1 

Comparison of Employer and Employee Ratings 
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Note: t-tests can be computed to see if there is a significant difference between 
employee and employer averages for each item. ^ 
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6. Job Satisfaction 

The four-item, seven-point Hoppock Job Satisfaction Scale was used to 
measure job satisfaction. The resCllts are shown in Table 9. 

Table 9 
Job Satisfaction 

ItQm No. Average SD No. 

Item 12 (like job) 

Item 13 (satisfied with job) 

Item 14 (changing jobs) 

♦ 

Item 1 5 (comparing job satis- 
faction with other people) 

TOTAL SCALE 



On the seven-point continuum, four represents the neutral point and ^ 
any score larger than that indicates job satisfaction in the positive direction. 

Looking at Table 9 in this light, we see that the clients averaged :for 

job satisfaction. This would indicate that, as a group, they were 

(e,g., satisfied, not satisfied with their jobs, etc J 

This rating can be compared with the clients' response to the question, 
"Do you get any enjoyment, aside from the money you earn, out of your 

present job?" (From Item 10, not included in a table). Of the 

clients respor^ding, % received very much Enjoyment, % much 

enjoyment, % little enjoyment and l- % received no enjoyment 

at all aside from the money earned. 

7. Self-Acceptance 

* A semantic differential instrument, using three bipof^)' adjective^^.was 
used to yield the client's self-acceptance measure. Table/IO shows these 
results. ^ 

Table 10 , \^ 

Self-Acceptance of Clients 

^ * 

Scale Average SD No. 

Sad ■ happy 
Dissatisfied - satisfied 
Pessimistic - optimistic 

TOTAL SCALE 
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Employed former VR clients, as a group, were 

(e.g., moderately happy, satisfied 

and optimistic) with averages of , , and : . Agai n, 

on this seven-point scale, any number above four shows a positive trend, 
while numbers below 4 show a negative trend. 

8. Attitude Toward Work 

Another semantic differential instrument, also using three bipolar 
adjective scales, was used to measure the client's attitude toward work. 
Table 1 1 shows these results. 

Table 11 
Client's Attitude Toward Work 



Scale Average , SD No. 



Bad - good 

Unimportant - important 
Dull - interesting 

TOTAL SCALE 



The results indicate that employed, former VR clients considered the 

"world of work" to be 

as indicated by their averages of , 

and . 

9. Familial Situation 

Four items (39 - 42) on the questionnaire dealt with the client and his 

family. Of the ^ married clients, (representing %) indicated 

that their spouse is now working. Of the clients wfth working spouses,. 

. (representing %) indicate that the spouse wants to work as 

opposed to (representing %) who feel that the spouse has to 

work. Of those married clients wftose spouse does not work, (No. = ), 

(representing %) state that the spouse wants to work but 

cannot, with the remaining %) stating that the spouse does 

not want to work. , accounting for %, did not respond to 

this question. 

On the question of agreement on family affairs, ^clients ( %) 

reported no agreement, clients ( %) reported r^re agreement, 

( %) reported agreement half the time, fL- (;li %) 

reported agreement most of the time, and ( %) reported agree- 

' ment always ( %) did not respond to the question. 
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This data shows that 



z (e,g,, generally clients' 

spouses want to work but cannot, and that there is moderate agreement 
on family affairs, etc J 

10. Correlational Analyses 

a. Correlates of Job Satisfaction 

-* 

The total score for Items 12 - 15 was compared with selected 
variables. The results are shown in Table 12. 

Table 12 

Correlates of Job Satisfaction 

^ \ 

Variable Correlation No. 

Age 

Number of dependents 
Education (grade completed) , 
Rating on VR services 

Length of time Kolcffng present job ' ' 
Hours per week (wock) 

Enjoyment out of job ' 
Client's rating of work personality 
Client's rating of work proficiency 
Client's rating of work personality 

and proficiency 
Employer's rating of work personality 
^rr\ployer's rating of work prof ioierjcy 
Employer's rating of work personajity 

and proficiency ^ ^ 

Employer's rating of overall perfo^ance 
Self-acceptance ' s 

Attitude toward work ^ % 

Agreement with spouse (family affairs) 
Occupational level 

b. Correlates of Self Acceptance ' 

Table 13 shows the results of a comparison of the toal score for 
Items 33 - 35 with selected variables. 
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Table 13 
Correlates of Self-Acceptance 

Variable Correlation No. 



Age ' « 
Number of dependents 
Education (grade completed) 
Rating of VR services 
Length of time holding present job 
Hours per week (work) 
Enjoyment out of job 
Job satisfaction 

Client's rating pf work personality 
Client's rating of work proficiency 
Client's rating of work personality 

and proficiency ^ 
Employer's rating of work personality 
Employer's rating of work proficiency 
Employer's rating of work personality 

and proficiency 
Employer's rating of overall performance 
Attitude toward work 
c Agreement with spouse (family gffairs) 



c. Other Correlations 

(Include any other correlations you rnay have computed). 

d. Conclusions and Recommendations 

Include here a brief summary of your findings, including an 
interpretation of what they mean You might like also to make 
recommendations. 

Special Notes: 

/. If you perform t-tests for Figure 1, it would be appropriate for those results 
to follow Figure 1 in that section. 

2. If you perform any Chi square analyses, you may place them in the appro- 
priate sections, did nO't include these tables since those individuals 
familiar with such analyses should have no difficulty in reporting them. 

i. Be sure to highlight any differences which show up between clients closed 
in Status 26 and those closed in Statuses 08, 28 and 30, as well as between 
employed and unemployed former clients. 

' 30 
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APPENDIX A 
Employee Questionnaire 



Dear. 



We are interested in your current employment. Please fill out the enclosed question 
naire.and return it to us in the self-addressed, stamped envelope. Thank you. 

Name: 

Age: — ; — ^ 



Marital Status: Number of Dependents: 

Education (circle the grade completed): 

0 1^2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 

A. 1. At the present time, a description of my work situation is (Circle ONE of the 
following categories): 

4 

1. Unemployed 

2. Training or schooling (full or part time) 

3. Self-employed 

4. Employed part time 

5. Employed full time 

If you are employed part time or full time complete the 
following: 



Name of the firm 
Address 



Phone Number 

tn^mediate Supervisor 



2. How would you rate the Vocational Rehabilitation services? 



1. Very good 

2. Good 

3. Uncertain 

4. Poor 

5. Very poor 
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3. Do you think you will need additional service from the Vocational 
Rehabilitation counselor? 

1. Yes 

2. No 

If you answered ^es, what services^ would you like to have 
offered j 

f 



IF YOU ARE NOT EMPLOYED, do not complete the rest of the 
questionnaire. Return the entire questionaire in the envelope provided, 

4. What is your present job? (Give title) 

5. Did Vocational Rehabilitation training prepare you for your job? 

1. Yes 

2. No 

6. Were you able to do this type of work before you contacted Vocational 
Rehabilitation? 

1 . Able to do this work 

2. Limited ability to do this work 

3. Not able to do this work 

7. Did the Vocational Rehabilitation counselor assist you in finding your 
job? 

1. Yps 

2. No 

8. How long have you had your present job months. 

9. How many hours do you work per WEEK, including the time it 
takes you to go to and from where you work? (Circle ONE) 

1. Not working now 

2. Less than 20 hours 

3. 20 - 40 hours 

4. Over 40 hours 

10. Do you get any enjoyment, aside from the money you earn, out of 
your present job? (Circle ONE) 

1. Not at all 

2. Little 

3. Much 

4. Very much 



ERIC 
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11. If at some time in the future you needed to get a job, do you feel that 
(Circle OfslE) 

1 . You should find the job for yourself? 

2. Your counselor should find the job for you? 

3. Some other agency should get a job for you? 

12. Circle ONE of the following statements which best tells how well you 
like your job. 

1. I hate it 

2. I dislike it 

3. I don't like it 

4. I am indifferent to it 

5. I like it 

6. I am enthusiastic about it 

7. I love it 

13. Circle ONE of the following to show how much of the time you feel sat- 
isfied with your job. 

1. All the time 

2. Most of the time 

3. A good deal of the^time 

4. About half of the time 

• 5. Occasionally "/ 

6. Seldom * 

7. Never 

14. Circle ONE of the following which best tells how you feel about changing 
your job. 

1. I would quit this job at once if I could get anything else to do. 

2. I would take almost any other job in which I could earn as much 

as I am earning now. 

3. I would like to change both my job and my occupation. 

4. I would like to exchange my present job for another job. 

5. I ara not eager to change my job, but I would do so if I could 

get a better job. 

6. I cannot think of any jobs for which I would exchange. 

7. I would not exchange my job for^any other. 

15. Circle ONE of the following to show how you think you compare with => 
other people. 

1. No one likes his job better than I like mine. 

2. I like my job much better than most people like theirs. 

3. 1 like my job Detter than most people like theirs. 

4. I like my job about as well as most people like theirs. 

5. I dislike my job more than most people dislike theirs. 

6. I dislike my jdb much more than most people dislike theirs. 

7. No one dislikes his job more than I dislike mine. 
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B. 16. I don't have trouble yvitH my co-workers. 

1. Strongly agree ^ 

2. Agree ^ 

3. Uncertain 

4. Disagree 

5. Strongly disagree ' 

17. I go to work on time and return from breaks on time. 

1. Strongly agree 

2. Agree 

3. Uncertain > 

4. Disagree 

5. Strongly disagree 

18. I get along well with my supervisor. 

1. Strongly agree 
-s^ 2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

19. I get my work done without being told by my supervisor. 

1. Strongly agree 

2. Agree 

3- Uncertain 

4. Disagree ^ 

5. Strongly disagree 

20. I try to look my.jDest when I'm doing my job. 

1. Strongly agree 

2. Agree ^ 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

21. I usually try to be polite to my supervisor and to others while I'm 
working. 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 
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22. I think I gain as much from the work as I put into it; 

1. Strongly agree ^ 

2. Agree ^ 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

23. I can always be counted on to get my job done. 

1. Strongly agree 

2. Agree , " 

3. Uncertain 

4. Disagree i 

5. Strongly disagree 

24. I don't mind working really hard all day long. 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

25. I start new jobs without waiting to be told by my supervisor. 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

26. I regard my present job as an important one. 

*1. Strongly agree 
- 2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

27. I think my knowledge about my job is 

1» Very good 

2. Good 

3. Fair 

4. Poor 

5. Very poor 
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28. My work skill in the trade is 

1. Very good ^ 

2. Good 

3. Fair 

4. Poor 

5. Very poor 

29. I think the quality of my work is 

1. Very good 

2. Good 

3. Fair 

4. Poor 

5. Very poor 

30. I think my operation and care of equipment are 

1. Very good 

2. Good' 

3. Fair 

4. Poor 

5^ Very poor 

\ 

31 . My observance of safety practices in the shop is 

1. Very good 

2. Good 

3. Fair . ^ 

4. Poor * ' \ 

5. Very poor 

32. I think my^ollowing the shop rules is 

1 . ^ery good 

2. Good . ' 
-^3. Fair ^ . 

4. Poor 

5. Very poor . . 

33. I myself am 

1. Extremely happy 

2. Quite happy 

3. Slightly happy ^' 

4. Neither happy nor sad 

5. Slightly sad 

6. Quite sad. 

7. Extremely sad 
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34. I myself am 

1. Extremely satisfied 

2. Quite satisfied 

3. Slightly satisfied 

4. Neither satisfied nor dissatisfied 

5. Slightly dissatisfied 

6. Quite dissatisfied 

7. Extremely dissatisfied 

35. I myself am 

1. Extremely optimistic _ 

2. Quite optimistic 
3r Slightly optimistic 

4. Neither optimistic nor pessimistic 

5. SiTghtly pessimistic 

6. Quite pessimistic 

7. Extremely pessimistic 

J36. The world of work is 

1. Extremely good 

2. Quite good 

3. Slightly good 

4. Neither good nor bad 

5. Slightly bad 

6. Quite bad 

7. Extremely bad 

37. The world of work is 

1. Extremely important 

2. Quite important 

3. Slightly important 

4. Neither important nor unimportant 

5. Slightly unimportant 
6., Quite unimportant 

7. Extrerhely unimportant 

38. The world of work is 

1. Extremely interesting 

2. Quite interesting . 

3. Slightly interesting 

4. Neither interesting nor dull 
-^..Slightly duM 

6. Quite duH 

7. Extremely dull 
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. If you are not married, skip iterhs 39 through 42, and return the completed 
questionnaire-to us in the self-addfessed envelope. If you are married, please 
complete itenis 39 • 42. 

39. Is your husband (or wife) working now? (Please circle) t 

1. Yes 

2. No. ^ 

40. If your husband (or wife) is working now . Circle ONE of the following 
statements. 

1. She (or he) has to work. 

2. She (or he) wants to work. ' ^ \ 

41. If your husband or wife is not working now. Circle ONE of the f.oUqy^ng 
statements. 

/ N I y 

1. She (or he) wants to but cihnot. ] 

2. She (or he) does not want tp. ^ 

42. Do you agree with your husband or wife on family affairs. (Please circle 
- ONE). , 

1. Never" 

2. Very rarely 

3. Half of the time 

4. Most of the time 

5. Always 

This is the end of the questionnaire. Please use the enclosed -self-addressed 
envelope to return the completed form to us. i 



Thank you for your cooperation. 



/ 
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APPENDIX B, 
Employer Questionnaire 

« 

Dear Sir/Madam: 

We are surveying the job performance of former vocational rehabilitation clients. 
We understand that the following individual is now working for you. Would you 
pfease have the immediate supervisor of this employee complete the questionnair.e 
and return it to us with the enclosed, self-addressed, stamped envelope? Thank 
you for your cooperation. 



Your Employee's Name: 

1 . What is this employee's iob title? 

2. How many hours does this employee work per WEEK? (f^ease circle one of 
the following categories) 

1. Less than 20 hours 

2. 20-40 hours 

3. Over 40 hours 

Items 3 through 21 are statements about this employee and his (or her) performance. 
Please read each statement carefully and circle ONE of the provided answers which 
indicates how much you agree or disagree with the item. 

3. The employee does not have trouble with ffls/her co-workers. 

1. Strongly agree 
.2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

4. The employee comes to work on time and returns from breaks on time. 

1. Strongly agree 

2. Agree ^ 

3. Uncertain 

4. Disagree 

5. Strongly disagree - 
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5. The employee gets along well with the supervisor. 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

6. The employee gets work done without being told by the supervisor. 



1. Strongly agree 

2. Agree 

3. Uncertain 
.4. Disagree 

5. Strongly disagree 



7. The employee tries to look his/her best when he/she is doing his/her job. 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree, 

* 

8. The employee usually tries to be polite to the supervisor and to others while 
he/she is working.,^ 

1. Strongly agree 

2. Agree 

3. Uncertain 
4., Disagree 

5. Strongly disagree 

9. The employee appears to be highly motivated in his/her work. 

1. Strongly agree / , 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

10/ The employee can always be counted on to get his/her job done. 

1. Stronglv agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 
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11. The employee doesn't mind working really hard all day long. 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

1 2. ^ The employee starts new jobs without waiting to be told by the supervisor. 

1. Strongly agree 
• • 2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree ^ 

13. The employees' attitude toward his/her present job is good. ^ 

« 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree'* 

14. The employee's knowledge about his/her job is 

1 . Very good 
^ 2. Good . . 

, 3, Fair <, 
. 4. Poor \ ^ 
' 5. Ve47 pooF 

16. The employee's work skill in the trade is 

1. Very good . / ' 

2. Good 

3. Fair 

4. Poor 

5. Very poor 

16. The quality of the employee's work is 

1. Very good 

2. Good » ' - 

3. Fair 

4. Poor 

5. Very poor 
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1 7. The employee's operation and care of equipment are 

1. Very good 

2. Good 

3. Fair 

4. Poor 

5. Very poor 

18. The employee's observance of safety practices in the shop is 

1. Very good 

2. Goad / 
^w-w., ^ 3. Fair 

4. Poor 
^ 5. Very poor 

v 

19. The employee's compliance with rules in the shop is 

1. Very good ' 

2. Good 

3. Fair 

4. Poor 

5. Very poor - ^ 

20. The employee's overall performance is satisfactory. 

» y, 

1. Strongly agree 

2. Agree 

3. Uncertain 

4. Disagree 

5. Strongly disagree 

21 . The employees training through Vocational Rehabilitation is important to 
his/her job performance. ^ 

.1"^ Strongly agree 
2. Agree 
^ 3. Uncertain 

4. Disagree 

5. Strongly disagree 

We would appreciate any other comments you may have about this employee or 
the Vocational Rehabilitation services. 



Thank you for your cooperation. 
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APPENDIXC 
Questionnaire Characteristics 

A. Employee Questionnaire 

Factors tapped by the questionnaire are shown in Table A in the text. The 
four-item Hoppock Job Satisfaction Blank (items 12 - 15 of the Employee Ques- 
tionnaire) is reported to have the split-half reliability of .87, corrected by the 
Spearman-Brown formula to .93 (N=301, Hoppock 1935). Dr. M. S. Tseng, of 
the Research and Training Center, had administered the Hoppock Job Satis- 
faction Blank and a 31 -item General Job Satisfaction Scale developed by the 
University of Minnesota Industrial Relations Center (Carlson, Dawis, England 
apd Lofquist, 1962) to a sample of former clients of the West Virginia Reha- 
bilitation Center, and obtained a very high correiation of .93 (N=52, p <.001) 
between the two job satisfaptidn i^ieasures. Based on this finding and taking 
into consideration that it consisted of only four items, the Hoppock Blank was 
selected to yield a global measure of job satisfaction of the VR 26's who were 
employed. 

The Tseng Work Personality subscale is an eleven-item summative rating 
scale (Items 16 - 26 of Employee Questionnaire) and is designed to yield a 
global measure of the individual's assessment of his own personal quality in 
a work situation. The eleven attributes that constitute the work personality 
measure are: the ability to work with others, punctuality, cooperativeness, 
self-reliance, appearance, courtesy, motivation, reliability, work tolerance, 
initiative, and attitude toward job (Tseng, 1972). This subscale has the 
split-half reliability (with^the Spearman-Brown correction) of .80 (N=113) 
and the internal consiste'ncy as measured by Cronbach Alpha of .86 (N = 1 13). 

The Tseng Work Proficiency Subscale is a six-item summative rating 
scale (Items 27 - 32 of Employee Questionnaire) designed to yield a com- 
posite score of the individual's assessment of his own proficiency on the 
job. The six attributes that constitute the work pfoficiepcy measure are: 
job knowtedge, job skill, quality of work, care and operation of equipment, ' 
observance of safety practices, and compKance with wo/k rules (Tseng, 
1972). The split-half reliability with the SpTearman-^rown correction and 
the internal consistency as measured by Cronbach Alpha of this subscale 
are .89 (N=1 13)^nd .84 (N=1 13), respectively. The total scale, the com- 
posite of work personality and work proficie'^ncy subscale, has the split-half 
reliability (with the Spearman-Brown correction of .88 (N=1 13) and the 
internal consistency (Cronbach Alpha) of .89 (N=1 13). 
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A client's self-acceptance>and attitude toward work were tapped by the 
seven-point semantic differential scales (Osgood, Suci, and Tannenbaum, 1957) 
with three bipolar adjectives for each of the two variables (Items 33 - 35 and 
Items 36 - 38 of the Employees Questionnaire). The three bipolar adjectives 
used to measure the client's self-acceptance are: happy-sad, satisfied-dissatis- 
fied and optimistic-pessimistic. The three bipolar adjectives used to quantify 
the clients' attitude toward the world of work are: good-bad, important-unim- ^ 
, portant, and interesting-dull. 
s 

Such familial variables as the sfiouse's employment status and the reasons 
behind it (Item 391- 41 of Employee Questionnaire) and spousal conformity 
on family affairs (Item 42 of Employee Questionnai^re) can be e:Kamined irt 
connection with the married client-employees. ^ 

B. Employer Questionnaire 

Variables tapped by this questionnaire are summarized in Table B in the 
text. The Tseng Work Personality Subscale for the Employer is an eleven-item 
summative scale (Items 3 - 13 of Employer Questionnaire) designed to yield a 
composite measure of the client's personal quality in a work situation as rated 
by his supervisor. This subscale-as does its counterpart for the client-employee 
(Itenr^s 16 - 26 of Employee Questionyiaire) deals with the following eleven 
attributes: the ability to work with others, punctuality, cooperativeness, 
appearance, courtesy, motivation, reliability, work tolerance, initiative, and 
attitude towacd job .(Tseng, 1972). The split-half reliability corrected by the 
Spearman-Brown formula and internal consistency as measured by Cronbach 
Alpha of this subscale are .94 (N=114) and .91 (N=1 14), respectively. 

The Tseng Work Proficiency Subscale for the employer is a six-item 
summative rating scale (Items 14 - 19 of Employer Questionnaire) that 
yields a global measure of the client-employee's work proficiency as rated 
by his supervisor. This subscale-like its counterpart for the client (Items 27 - 
32 of Employee Questionnaire) deals with<six attributes: job knowledge, job 
skill, quality of work, care and operation of equipment, observance of safety 
practices, and compliance with work rules (Tseng, 1972). It has the split- 
half reliability with the Spearman-Brown correction of .94 (N=1 14) and the 
internal consistency (Cronbach Alpha) of .89 (N=114). 
i ' 

The total scale (composite of work personality and work proficiency 
subscales) has the split-half reliability corrected by the Spearman Brown 
formula and the internal consistency as measured by Cronbach Alpha of 
' .95 (N=1 14) and .94 (N=1 14), respectively. 
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SAMPLING: THE WHY AND HOW 
Parti 



Evaluating different aspects of the vcxa- 
tional rehabQitation (VR) prograna is the only 
way to find out how well the program is doing. 
But, who has time to look at every case for 
every evaluation study to be conducted? No 
one! 

Actually, it really isn't necessary to exam- 
ine every case or file to get a picture of what's 
going on. For instance, when a doctor does a 
blood test, h^ takes a small portion -or sam-^ 
ple-of blood and runs an analysis of this. He 
can then make statements about the entire 
bloodstream, based on this blood sample. 

How Does This Relate To The VR Program? 

You can do the same thing in VR. All the 
people in a particular category that you are 
trying to make some determinations about are 
called a population, just as all your blood rep- 
resents a population. For example, a popula- 
tion might be all of the cases ever closed in 
status 26 in your territory. If you wanted to 
have some answers about all these clients, you 
could ask everyone of these persons (the pop- 
ulation), or you could ask some of them (a 
sample). The portion of any population that 
you tadk to, then, becomes your sample. 

What Are The Advantages of Sampling? 

For instance, with your caseload, you can 
take a sample of all youir cases, look carefully 
at some aspects of these cases, and make some 
generalizations which will apply to your entire 
caseload. 



To give you som6 other examples, a reha- 
bilitation counselor- or state evaluator, or dis- 
trict supervisor -might want to answer some 
questions about (1) caseload for the current 
fiscal year, or (2) all the cases closed in status 
08 during a certain length of time, or (3) all the 
cases in a particular disability category. By 
taking a sample, you are able to find out the 
same things you would have found out if you 
had looked at everyone in the population. 

Since it is often too time-consuming to con- 
sider working with the entire population, we 
have to limit ourselves to studying a selected 
number of the members of a particular popu- 
lation. Otherwise, we would be severely lim- 
ited in the number of evaluations we could do. 

But, What Is A Good Sample? 



Sampling techniques have been developed 
that will permit us to study a population by 
drawing the sample in such a way that it is rep- 
resentative of that population. Since the num- 
ber of possible rehabilftation populations is 
limited only by the needs and/or the creativity 
of the person studying the VR program, sam- 
pling techniques be'come a very important part 
of evaluation. 



Since we've said that it's O.K. to draw some 
conclusions about a population by examining 
a few members (sampling) from that popula- 
tion, the question arises- how do you know 
which cases, to look at? 
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The most common method for selecting a 
good sample is to randomly choose members 
from that population. (We will discuss ran- 
dom sampling in the next issue.) A random 
sample will aUow you to get^a representative 
group so you can make unbiased generaliza- 
tions about your total population. 

What Do You Mean By Unbiased? 

Remember, a sample "represents" an entire 
population. A biased sample is one that is not 
truly representative of a particular population. 
Care must be taken to be sure that your sam- 
ple is unbiased (or as unbiased as possible). 
So, if the sample is drawn from a population 
in a biased way, then the sample is not repr^ 
sentative of the entire population and limits\ 
the validity of your generalizations. Some 
examples of a biased sample would be: 

1. Taking every third client file for case 
review (not every client had an equal 
chance of being chosen) . 



2. All the clients in district A to represent 
clients acrpAs the state. (District A may 
not be s^rVsentative of all other dis- 
tricts). 



How Many .People Do I Need For A Sample? 

It will vary, depending on the total number 
in your population. Ten percent of 10,000 
cases (a sample of 1,000) is a good sample, but 
10% of 100 cases (a sample of 10) isn't very 
good. We'll cover this later and give you some 
general guides. 

What Next? 

In addition to general guides on how many 
to use in a sample, we'll be covering the use 
of the table of random numbers to get your 
random sample, and will cover another kind 
of sampling that you will want to consider 
using for certain kinds of evaluation. 
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RANDOM SAMPLING / 
Part II / 



We discussed the vfrhy and how of sampling 
techniques in the previous issue. We stated 
that the most common method of selecting a 
good sample is to randomly choose members 
from a population but didn't tell you what to 
do. 

How Do You Get A Random Sample? 

A simple method of random sampling is to: 

1. Assign a number to all members of the 
population. 

2. Write those numbers on individual 
pieces of paper and put them in a con- 
tainer. 

3. Draw out a number. Note the number 
that you draw, and place that number 
back in the container, and drawanother 
number. (You may end up drawing 
the same number twice, but that's 
O.K.)- 

4. The numbers you draw represent the 
members of your population that are 
to be included in your sample. 

A random sample, then, is a sample in which 
every member of the population has an equal 
chance of being chosen-every time. 



DoesnTThat Make For A Big Container^ 

We gave you thfs method to show you the 
principle. It can be useful in some cases, but 
it could be time-consuming-especially if the 
population is large. However, there are other 
ways of getting a random sample that have the 
same effect. These methods include using 
random tables or letting a computer choose 
your sample for you. 

How Da You Use The Table of Random 
^ Numbers? 

A table of random numbers is designed with 
rows and columns of digits from 0-9 that have 
been arranged randomly. Each digit has about 
an equal chance of occuring at any place in the 
table. This way the table can be read in any 
direction and starting from any point on the 
table. In using the table the first thing to do is 
to assign a number to each subject in the pop- 
ulation. The numbers all must have as many 
digits as the total number of the j)opulation. 
For example, if the population has 987 clients, 
the first subject will be 001 and the tenth sub- 
ject will be 010. Each will then have three 
, digits. If your study, for instance, is of 56 
people, closed in status 26 during 1965, the 
first case wUl be assigned 01, the tenth 10, etc. 



What^s Next? 

Now that each client or member has been 
assigned a number, let's take a close look at 
how to use the table to assign members of" a 
population to a sample. 





00000 


00000 


Row 


01234 


56789 . 


00 


23157 


54859 


01 


05545 


55043 


02 


14871 


60350 


03 


38976 


74951 


04 


97312 


61718 


05 


11742 


69381 


06 


43361 


28859 


07 


93806 


20478 . 


08 


49540 


13181 


09 


36768 


72633 


10 


07092 


52392 









, For example, we, have a group of seventy- 
five people which we have assigned the num- 
bers 01 to 75. We want to select 10 subjects. 
Let's begin by reading the first two' digits of 
the second column. Going down we find 54, 
55, 60, 74, 61, 69, 28, 20, 13, 72, and 52. 
The subjects who have these numbers vrill be 
the sample of ten. * 

What Else Do I Need To Know? 

A number that is higher than the number of 
people in your population'is just ignored. (We 
had 75 people. If the number in table was 76 
or larger, we'd ignore it.) Also, you don't need 
to pay any attention to a number if you find 
it more than once in the table. If you finish 
one column or row and you don't yet have 
enough subjects, you can begin another column 
or row wherever you choose. 

We reproduced a small segment ffom a ran- 
dom table for demonstration purposes. Any 
statistics textbook will have a Table of Ran- 
dom Numbers which you can use for selecting 
a sample from any population you are going to 
work with. 
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STRATIFIED RANDOM SAMPLING 
Part III 
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In the last issue we established that simple 
random samplmg is a method of drawing 
samples such that each and every member of 
the population .has the same chance of being 
included m the sample. One method is the 
lottery. Another is with the table of random 
numbers. Simple random sampling is an ex- 
cellent way to look at a portion of all the 
cases and make some generalizations about 
the entire population. This works well when 
you are lookmg at the population as a group 
of people that is pretty much alike. For ex- 
ample, you can draw a sample from all the 
cases in your territory, unit, or district' that 
were closed in fiscal year 1972. You can make 
some statements about all these clients.- 

What About Members Who Aren't Alike? 

Categories are not always the same' There 
are some very important categories in which 
clients can be included, e.g. by disability, age, 
rural or urban residents, etc. Other categories 
might be type of program, kinds of services re« 
ceived, or amount spent on services. It may 
be important for you to make sure that your 
sample includes some members from certain 
subgroups, which researchers call strata. A 
type of sampling has been developed to obtain 
a sample which is representative of cases in all 
the strata. . stratified random sampling. This 
is what we will talk about in this issue. 

Give Me An Example! 

Your population is all the cases carried by 
field counselors in your district (1000 cases), 
and you are interested in the type of clients 
seen by the different counselors. Let's assume 
that (1) there are 10 field counselors, and (2) 
each counselor carries a varying percentage of 
the cases. (See Chart I). 



To draw a stratified random sample we 
should decide how many clients we'll have in 
our sample. Let's arbitrarily say we'll pull 
100 from the 1000. To be representative of 
each strata (i.e., each counselor's caseload), the 
percentage of cases from each strata in the 
sample should be the same as the percentage 
of cases Jrom each strata in the population. 
For example, in this district, counselor 1 has 
20%, i.e., 200 clients. To draw a stratified 
random sample we would pull 20% of our 
sample from counselor 1 's 200 cases, 10% from 
counselor 2*s 100 cases, 10%> from counselor 
3's 100 cases, etc. So in our sample of 100 
we'll have 10 strata, with varying numbers of 
cases in each. This example is illustrated in 
Chart II. 



Another example of a stratified random 
sample: Counselor Smith has 100 active cases. 
Sixty clients (60% of his caseload) have ob- 
vious physical disabilities. The other 40 cli- 
ents (40% of his caseload) have handicaps 
which don't show. He is going to survey a 
sample of his clients for attitudes toward their 
disabilities and wants<«to fairly represent those 
vnth visible problems and those with hidden 
disabilities. He vnll randomly draw 60% of 
his sample from those clients vnth physical 
disabilities and 40% from the clients who have 
hidden disabilities. Counselor Smith has drawn 
a stratified random sample. 



In review, stratified random sampling is a 
way to look at a population that has various 
segments and to proportionally represent each 
segment in the sample. The sample of each 
segment is selected randomly and independ- 
ently from the sample of any other segment. 
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SAMPLING: LOOKING AT SAMPLE SIZE AND BIASES 

Part IV 



In earlier issues on sampling we talked about 
the importance of having a random sample to 
assure that your results would be representa- 
^tive of your total population. 

Sample size is another important part of 
sampling. If the sample is too small, it will not 
be representative of the population. On the 
other hand, if your sample contains more cases 
than you need, it could be both time-consum- 
ing and tedious. 

How Large Should A Sample Be? 

We know of no "cut and dried'* formula or 
tablafor determining exact sample size. How- 
ever, we can suggest some ranges that you m^y 
use as guidelines. These suggestions are based 
on our experience. There are more compli- 
cated statistical techniques for determining 
certain size samples for specific uses, but the 
ones we list in the table below should be ade- 
quate for general use. 

Samples which correspond to our guide will 
aUow you to safely generalize from your sam 
pie to your population. Our suggestions are 
for different sized random samples. 

The lower end of the range in the table 
represents the minimum percent you should 
consider and the upper end, the maximum. 



Selecting Sample Size 



Size of - Percent of Population 

Population to be in Sample 



1-10 Use all cases 

10- 100 50- 100% 

100-250 25-50% 

250 - 500 10 - 25% ^ 
500- 1000 ■ 5-10% 

1000-5000 2-5% 

Over 5000 1 • 2% 



Are Things As Good As They L&ok? 

A common method of gathering information 
for a study is to. mail questionnaires. The 
mailing list is a randomly selected sample, but 
usually only a portion of the questionnaires 
are returned. The characteristics of pepple 
who return these forms may affect the infor- 
mation you are trying to obtain and, therefore, 
may not be representative of the sample. For 
instance, if you are asking clients in status 20 
if they are looking for etnployment and 60% of 
those chents poUed respond, these responses 
will probably be made by the more depend- 
able or active clients who cannot represent all 
the clients in the sample. These two person: 
ality characteristics seem more common to 
people who actively seek employment. So you 
have what is known as a biased sample. In 
biased sampling certain types of cases have 
more chances of being selected. 



What Can You Do About These Biases? 

Unfortunately, sometimes you can do noth- 
ing about some biases. For instance, with the 
questionnaire^rsurvey techniques, there is very 
little you can do about the characteristics of 
people who respond. Just knowing that some 
of these biases might show up can help you 
clarify your results. If you write a report of 
your findings, note these biases in a section 
such as "limitations" or in the definition of 
your sample or population. 

What If I Don't Have Much Choice? 

So far we've discussed the more ideal or 
"pure" methods of sampling. But, practically 
speaking, some tlients are more available than 
others. Let's consider a study done by a state 
director of vocational rehabilitation who 
chooses to select a sample from clients in one 
territory in tiie state's largest city, where he 
happens to be, rather than choosing a sample 
from all the "clients in the state. He is asking 
tile clients that were closed in status 26 last 
year, how many job interviews they went to 
before they actually obtained employment 
His sampling technique is called incidental 
sampling, i.e., using those cases or items that 
are most readily available. He is using clients 
from one territory from his own city, rather 
tiian from the entire state. 



What Generalizations Can You Make 
From Incidental Samples? 

You've got to be more careful in defining 
your population from which an incidental sam- 
ple is drawn. Each .significant property of the 
sample that might be related to tiie outcome 
tJiat you are looking at must be defined. You, 
can then generalize to the population that has 
these same significant characteristics. Let's go 
back to the example. The state director might 
find that the clients who were closed in "26" 
tha'^t he questioned went to an average of 8 
job interviews before they obtained employ- 
ment. Some significant properties of his sam 
pie are availability of transpurtation and a high 
number of new job listings daily. His con- 
clusions would not be valid for a population 
that didn't have tiiese same properties, for 
instance, a territory in a rural farming com- 
munity. But his findings probably do gener- 
alize to other territories in the same city and 
other cities of comparable size and industry. 
So, incidental sampling can be useful. 

And So 

In the last few issues we've discussed seyeral 
of the most common types and most reliable 
ways of drawing a sample. If you have a prob- 
lem, contact your R & T Center or a text on 
research design or statistics,- 



This issue was prepared by Alice Randolph in collaboration with M. S. Tseng and Kathryn Greever, Research and Training Center. West 
Virginia University, 509 Allen Hall, Morgantown, West Virginia 26506. ♦ 

'.A 

P6VRS, a special series of Rehabilitation Tomorrow, will be released periodically by the Research and Training Center, Institute, West 
Virginia 2511 2. The R & T Center is sponsored jointly by West Virginia University and the West Virginia Division of Vocational ^e- 
habilitation and supported in part by Grant RT-15. Social and Rehabilitation Services - Deportment of Health, Education and Wel- 
fare. Washington, D. C. 



ERIC 



iLZ ON Itl^tiBd 
AM'N0lS3nWVH3 

39VXS0d s n 
3XV« ><in9 



5i} uajUMao ONiNivttx aiMV Howx^eati 



ZllSr ViNI9HIAlS3M'3inillSNI 




0 



-61- 
APPENDIX E 

« 

Additional Questionnaire Items ^ 

1. What wa^ your spouse's (or parents'! attitude towards your participation in 
the rehabilitation program? 

1. Favorable 

2. Unfavorable 
- . 3. Indifferent. 

2. To what extent do you feel that your family understands the problems you 
have experienced? 



.1. Not at all 

2. Somewhat 

3. Moderately 

4. A great deal 

5. Completely ' 

3. Has your spouse (or parents) been helpful in your efforts to become retrained 
or ehnployed? 

.1. Not at all 

2. Somewhat. 

3. Moderately 

4. A great deal 

5. Completely 

4. Rate how well you get along with each of the following members^qf your 
family. / 



Mother Father Spouse Sons Daughters 



1. Not at all 

2. Very poorly 

3. Fairly well 

4. Well 

5. Very well 



.1 
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Put the appropriate number in the blanks. 

1. Not atall 

2. Sometimes 

3. Usually 

4. Most of the time 

5. A great deal 

I like to: 

Tell other family members what to do. 

Be busy or actively involved in family activities. 

Try-out or do new things with the family. 

Do things alone, without the rest of the family, 

Receive recognition in my family for the work that I do, 

Consult the rest of the family on the decisions I make. 



V 
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' APPENDIX F 
Rehabilitation Center Clients Follow-Up Study by 
Research and Training Center and West Virginia 
Division of Vocational Rehabilitation 



ERIC 



QUESTIONNAIRE 



Interviewer' 



Date. 



Serial Number. 



1. Name 



2. Address 



3. Phone 



street 

4. Date of Birth 



city 

5. Sex 



County 

6. Race 



7. Marital Status 

Before 

After 



8. Dependents before . 

after 



9. Education before 
after _ 



10. Disability before, 
after . 



12. HovV long? _ 
14. If not, why? 



1 1 . What training did you receive at R. C? 
13, Did you complete it? Yes No 



15. Did you receive any further training after leaving R. C? Yes No _ 

16. If yes, in what area? 17. How long? 

18. Sponsored by ^ ; 

19. Did you have any special training before coming to R. C? Yes No _ 

20. If yes, in what area? ^21. How long 

22. Sponsored by 23. Are you working now? Yes^ 



No 



24. List all jobs you have had up to the present starting from most recent job. Also, indi 
cate the first job you had after leaving R. C. (If needed, use additional sheet of paper). 

Date Income Reason for 

Job Title From To Per Month How Obtained Leaving 

1. • ' ' 

2. ' . • 
3. 
4. 
5. 
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25. What w3s your source of income during unemployment? 



26. What is the name and address of the last employer? 



27. How many times have you been at the Rehabilitation Center? 

28. How would you rate the services you received from R. C? 



(1) Very Good (2) Good (3) Moderate (4) Bad (5) Very BacL.^ 
Training l_ 



Treatment 
Counseling 
Food 

Recreation 



Living Conditions 



29. Did R. C. services help you YES NO 

to'get a job? 1 2 

in work adjustment? 1 2 

in personal adjustment? 1 2 

30. In an overall manner, how much did you gain from the R. C. services? 
(1) Very Much (2) Lot (3) Some (4) None (5) Wasted My Time 

31 . Did you hesifate to go to R. C. when first asked to by the counselor? Yes J_ No 2 

32. If yes, why? 

33. ' Did you change your mind (attitude) about the R. C. when you finished the 

programs? Yes _1 No 2 



34. If yes, why? 

irv 

35. What is the thing you liked least about the R. C? 

36. What is the thing you liked most about the R . C? 



37. Do you have any suggestions by which R. C. couid serve you better? 
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APPENDIX G 
Spread Sheet 
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. APPENDIX H 
Forms for Compiling Data 

The following forms are to be used for hand tabulation of data from Employee 
Questionnaires. Similar sheets can be made up for the Employer Questionnaire. 

INSTRUCTIONS 

1. Assign a number to each questionnaire. For ease in locating matched pairs of 
employees and employers, you rhight use the same number for both with a 
suffix to denote the employer, e.g., 14 and 14A. 

2. Enter the information from a questionnaire all on one line across the page. 

3. Place an X m the appropriate column for each item on the questionnaire 
(excluding age where you would enter the actual age). Columns headed "NR" 
are used to indicate that the client did not respond to that item. 

4. To secure totals, simply count the X's in the appropriate columns. 

5. Transfer these totals to the appropriate tables in Section III. 

NOTE: 1 . For unemployed clients it will be necessary tq make entries on only 
pages 1 and 3 of the forms. 

2. If you are surveying clients closed in more than one status^ i.e., OS's 
and 26's, you can take the appropriate number of columns on page 2 
'to record this information. Or you may keep the statuses separate 
and record all of one status responses before including the responses 
of the other group on the forms. The important thing is to be able 
lo identify the closure status of each client. 
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APPENDIX I 

What Standard Deviation Can Tell Us 

We've all heard the terms "range" and "standard deviation". The standard 
deviation (SD) allows us to look at the range in a more meaningful manner. 

What bo You Mean? 

The SD tells us how our numbers (or scores) are grouped or spread out from 
our average. Let's assume that you have two groups of clients in a training program. 
The average (mean) IQ for each group is 70. You might be tempted to say that the 
groups were comparable, especially if the range was 55-85 for both groups. But 
that isn't necessarily so. Our problem is to look at tw6 groups, both with a mean 
of 70 and a range of 55-85 to see if the two groups are equal. We can tell this by 
using the SD. 

9 

Of course, if the ranges were different-say a range of 40-100 as opposed to 
55-85-you would expect variation in ability. Because the 55-85 range is not as 
wide as 40-100, you know that the 55-85 range group has scores closer to the 
average of 70 than the group with a range of 40-100. Or, saying it another way, 
the scores of the 40100 range group are more spread out than the 55-85 range 
group. 

Show Me How The SD Would Help 

Let's look at our two groups, each with a mean of 70 and each with a range 
of 55-85. Now, let's assume we have a normal distribution. Also, let's assume 
one group has a SD of 5, and the second group has a SD of 3. Graphically, these 
would look something like: 




You Have One Curve and Two Scales, What Does It Mean? 

You can look a,t the curve and see tf^at group 2 with'the SD of 3 has a scale based 
on addmg or subtracting 3 to the mean of 70; 4nd group 1 has a scale based on adding 
or subtracting 5 from the mean of 70. This tells us how the scores are distributed. 
Small SD'sinean scores clustering closer around the mean than large SD's which indi- 
cate wider variability or scatter. Therfore, group 2, with a SD of 3, has more IQ scores 
closer to the mean than group 1 with a SD of 5. 



81 



■84- 



How Do You Know That? 



Using the principle of the normal curve, your SD tells you how your scores are 
grouped around the mean in percents, assuming your distribution is normal and bell 
shaped. 
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So, 34.13% of your cases fall at 1 SD below the mean, and 34,13% at 1 SD above 
the mean. Going back to our lti^amp|e^ith our SD of 3, 6^.26% of the cases fall 
between an IQ range of &773 (70 ± 3K .With our SD of 5, 68.26% of the cases fall 
between 65-75 (701 5). At 2 SD's above and below the mean, with a SD of 5, 95.44% 
(adding our percents from the curve) fall in the 60-80 range (2x5= 10; 70+10). 
Computing for 2.SD's above and below the mean, with a SD of 3 gives us a range of 
64-76. At the lower end of our scale, group 2 has fewer people with an IQ of 55 
than does group 1 . I n our example, the differences may not be significant in a 
training program group, but it serves to show you the concept of SD. 



Of course, if you are dealing with only a few cases, you can probably look at the 
figures and find out what you want to know. But, l^t's assume you^re looking at all 
the clients in a district or state. With, say, 1000 or more clients, calculating the SD 
can give you a picture ^ou could never get by j^ffriooking at the scores. 

How Do You Get a Normal Curve? 
k 

A normal curve is based on distribution across an entire population or group of 
things. For example, if you plotted the IQs of all the people in the U.S., you would 
have a normal curve with a mean and median of 100. [Median is the midpoint. Half 
the scores *fall above it, and half below). 



Are All Curves Normal? 



No. When you have a mean and a median that is different, you will have a curve^ 
that has its hump to the left or right of the mean-that is, you have a skewed curve. 
This happens when you are dealing with small samples or small groups of numbers. 
'However, for most purposes you can assume a normal curve and use your percentages 
accordingly. You need only bear in mind that the further apart the mean and median 
are,'the more skewed your curve is. A mean of 100 and a median of 99 is quite 
close-almost normal. However, a mean of 100 and a median of 90 is rather skewed. 
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Calculating the Standard Deviation Using State Averages For 
TotaJ Number of<;Hents Served During.FY 72 

* 

States report the average number of clients served per counselor during a year. 
Let's look at these figures (See Table 1 ). First, we have ranked the state averages 
from high to low. Our range is 20 to 299 for 54 VR prograoj^s, including those out 
side the continental U.S. We can calculate our mean by adding up all the figures 
and dividing by 54. That number is 141. We can get our median by determining 
the point at which 50% of the cases fall above and 50% below. That number is 
135. 

But What About Standard Deviation? 

In our table, we have two columns of figures. Column 1 represents the ranked 
state averages. 

Step 1. Put your data in a list similar to Column 1 (no particular order is. 
necessary; we ordered for demonstration purposes only). 

Step 2. Add up all the numbers and get a total. The total for our example 
is 7590 (that's the same figure we used to get the mean). 

Step 3. Square all the individual scores (we did this for you in Column 2) 
and add the squared values. Our total here is 1,237,412. 

Step 4. Square the sum obtained in step 2 (7590 x 7590 = 57,608,100); 
# and divide that by the number of scores in column 1 (57,608,100 / 

54 = 1,066,816.66). This^number is called the correction term. 

Step 5. Subtract the value obtained in step 4 (1,066,816.66) from the value 
obtained in step 3 (.1,237,412). This number is 170,595.34. 

Step 6. Divide the number obtained in step 5 by the number of scores in 
column 1, minus 1 (54 • 1 = 53). 170,595.34 / 53 = 3,218.78. 

Step 7. Take the square root of that number. { 3,218.78 = 56.73 = SD. 

With our mean of 141, and our SD of 57 (rounded from 56.73), we know 
that 68.26% of ouf state averages fall between 81 and 198 (141 + 57), assuming 
no mathematical error andassuming that the distribution is normal. Another 
13.59% fall between 24 and 81, and another 13.59% between 198 and 252, and 
so on. \ 

If we were interested in studying optimum counselor caseload, we would 
probably look at those that fell below one SD from the mean to determine 
reasons for lower caseloads. This could be due to such things as: 
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1. 
2. 



inadequate professional or support staff; 
poor or few referrals; 



1 a high percent of new-counselors; 

4. more intensive counseling program; 

5. concentration on hard to rehabilitate cases. 

•Similarly, a higher than average caseload (more than 1 SD above the mean) could 
be due to: 

1. good organization; 

2. maximum use of paraprofessionals or adequate professional staff; 

3. innovative program features; 

4. lower incidence of hard-to-rehabilitate-tases. 

Our task here has not been to say what a state's caseload should be. Rather we 
have sTiowed how SD can be used by states for various kinds of comparisons. Also, 
we do not intend to imply that the average in this example should be considered an 
optimum caseload. By looking at extremes on both sides of an average, a state can 
begin to develop data to help improve such things as caseload management. A state 
might consider this approach, using its own state data, to study caseloads by various 
.locations, e.g., corrections, mental hospitals, district office, etc. 



Table 1 



Column 1 



Column 2 



Column 1 



Column 2 



20 
3.6 
62 
73 
77 
81 
89 
91 
92 
94 
95 
97 
103 
103 
104 
107 
108 
109 
109 
111 
111 
117 
123 
125 
125 
131 
133 



400 
1,296 
3,844 
5,329 
5,929 
6,561 
7,921 
8,281 
8,464 
8,836 
9,025 
9,409 
-10,609 • 
10,609 



10,816 ' 



11,449 
11,664 
11,881 
11,881 
12,321 
12,321 
13,689 
15,129 
15,625 
15,625 
17,1Q1 
17,689 



136 

137 

137 

140 

141 

142 

147 

151 

157 

162 

166 

168 

172 

179 

185 

186 

189 

t89 

190 

193 

197 

202 

220 

231 

255 

293 

299 



18,496 

18,769 

18,769 

19,600 

19,881 

20,164 

21,609 

22,801 

24,649 

26,244 

27,556 

28,244 

29,584 

32,041 

34,225 

34,596 

35,721 

35.721 

36,100 

37,249 

38,809 

40,804 , 

48,400 

53,361 

65,02&- 

85,849 

89,401 
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APPENDIX J 

Job Performance and Satisfaction of Successfully Closed 
Vocational Rehabilitation Clients* 

M. S. Tseng 

Rehabilitation Research and Training Center (RT-15) 
West Virginia University 

ABSTRACT 

Occupational functioning of those disabed employees who had been successfully 
closed by a state vocational rehabilitation agency and were gainfully employed was 
investigated through the data collected from 65 such clients and 75 employers. While 
the employers as a group wer/ considerably satisfied with their disabled employees in 
terms of work personality and proficiency and overall performance, the disabed em 
ployees themselves expressed moderately high degree of job satisfaction, attitude 
toward work, and self-acceptance. In comparison to their respective employers' 
ratings, the disabled clients tended to overestimate their own personal quality as 
measured by an 11 -item work personality scale (t.= 3,49, 51 matched pairs, £<.01). 
Among the significant correlates of job satisfaction found were work personality 
(r^= .28, df = 49, p<.05) and self-acceptance (r = .34, df = 53, p<.Ol). Self-accep- 
tance proved to be a significant correlate of attitude toward work (r = .35, df = 56, 
pc.01) which was in turn significantly associated with spousal conformity on 
family affairs (r = .63, df = 27, p<.00l). 




* Paper presented to the 1973 National Conference of National Rehabilitation 
Association, Atlantic City-, October 31, 1973. 



86 



•90- 



Job Performance and Satisfaction of Successfully Closed 
Vocational Rehabilitation Clients^ 

/ _ 

M. S. Tseng2 

Rehabilitation Research and Training Center (RT-15) 
West Virginia University 

The functioning of vocational rehabilitation system may be viewed in a macro 
fashion as an input-intervention-output system in which the three basic stages mput, 
intervention, and output constitute a loot^ing cycle. 

Included in the input stage are the components of general population, including 
a sub population consisting of those people who need rehabilitation and another 
sub-population comprising those people who serve as rehabilitation agents. 

The second stage represents. the intervention phase during which vocational 
rehabilitation is to take place. The disabled person may go through this stage 
entirely on his own resources.^nd/or via the assistance provided by public or 
private organizations including vocational rehabilitation agencies. During this 
intervention stage vocational rehabilitation agencies provide diagnostic and eval- 
uation, counseling and guidance, physical restoration, training, placement, and 
follow-up services as vehicles for intensive interactions between the client and « 
rehabilitation agents. These interactions are designed to pool together the 
client's own resources and the resources of his environment in order to achieve 
not only the enhancement of the client's rehabilitation potential but also*the 
facilitation of rehabilitation process itself. ^ 

/ N 

The^cli^nt then moves on to the output stage where his dependency Is 
lowered, self care improved, self support attained or regained, and .family life 
strengthened (SRS program objectives, 1968). In completing the loop, he goes 
back to general population, even becomes part of rehabilitation resources, in 
the input stage. Of course, he may need further rehabilitation and move on 
again, therefore, to the intervention stage and so forth. 

This study was undertaken primarily for the purpose of assessing the 
occupational functioning of those former clients who had.been successfully 
closed by the vocational rehabilitation agency. As such it can be classified 
as an output study within the framework of the macro system of vocational 
rehabilitation described above. 
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In investigating the effects of vocational training, viewed as an intervention, 
upon vocational rehabilitation, the author has conducted several studies relating 
client personal characteristics and work proficiencies to such intermediate VR 
system's criteria as trainability, training satisfaction, training outcome, and 
employability (Tseng, '1970; Tseng, 1972, a, Tseng, 1972, b. Tseng, 1972, 
c. Tseng, 1973). The present study went beycTnd the intervention phase. It 
attempted to follow-up those clients who were successfully closed by the voca- 
tional rehabilitation agency.and were gainfully employed in the output stage. 
Specific information sought in this study included employment status, job 
performance, job satisfaction, attitude toward work, .self-acceptance, familial 
data, clients' view of VR services, and interrelationships among these variables. . 

METHODOLOGY 

Subjects 

Former rehabilitation clients and their employers constituted the subjects 
of this research project. Clients were drawn from the annual listing of successful 
closures of a local vocational rehabilitation office in West Virginia. Among a 
total of 280 VR 26's (slfccessfully closed cases), 77 were homemakers and, 
therefore, excluded from study. Questionnaires were sent to the remaining 203 ' 
clients and 1 12 respective employers. Of these individuals 81 clients and 100 
employers responded. Among the 81 client respondents 65 were still gainfully 
employed, 4 were self-employed, and 1 2 were nVlonger employed. Of the 100 
employer respondents75 reported that the corresponding clients were still 
employed and 25 responded that the corresponding client^ were no longer 
employed by them. Therefore, 65 employed clients and 75 employers consti- 
tute analyzable cases. 

Among the 65 employed clients 37 (accounting for 57%) were married, 
13 (20%) were single, and 15 (23%) were separated, divorced, or widowed. 
The distribution of these iformer clier\ts in terms of their primary disabilities 
was as follows: visual impairments 8 (accounting for 12%), hearing impair- 
ments 7 (1 1%), orthopedic deformity or function impairment except ampu- 
tation 9 (14%), absence or amputation of major members 4 (6%), mental 
disorders 5 (7%), allergic and metabolic diseases 2 (3%), cardiac and respira- 
tory diseases 4 (6%)*, digestive system disorders 13 (20%), genito-urmary system 
df^der 1 (2%), speech impairment 1 (2%), and disabling conditions for which 
etiology is not known or not appropriate 11(1 7%). ^ 

The VR services rendered to these clients included counseling, physical 
restoration, and vocational training. All clients received varying degee o1 
counseling plus services relating to physical restoration and/or vocational 
training. Of the 65 clients 13, accounting for 20%,, received training (with 5, 
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accounting for 8%, in college, 8, accounting for 1^%, in vocat-ional and technical 
training programs) and 52, accounting for 80%, received services in physical 
restoration only (medical and surgical treatment 39, accounting for 60%, 
psychiatric or therapeutic treatment 2, accounting for 3%, appliance 11, 
accounting for 17%). 

Types of business and industry represented by the employers who^com- 
pleted the questionnaire, and for whom 75 VR clients were working, are auto- 
mobile body shop, automobile dealer, automotive Springs and service, bank, 
beauty salon, can manufacturing, church, coal rlRining, coffee shop, college 
dormitory, community action organization, construction materials and 
supplies, county board of education, delivery company, gas station, glass 
factory, grade school, grbcery store, heating pompany, high school, hospital 
and clinic, homeowner, hotel, industrial supplies, lumber company, metal 
products, nursing home, optical company, power plant, realty company, 
restafurant, retail store, sheltered workshop, state department of employment 
.security, state department of highways, state police, and transportation (bus) 
company. 

Out of the#65 client and 75 employer cases whose data were analyzable, 
54 matched pairs of employed clients and their respective employers were 
identified. 

Instruments 

Two questionnaires-one constructed for the successfully closed VR 
clients (Status 5fit) and the other designed for their respective employers- 
were used. Questionnaire a3 was mailed to the former VR clients to tap 
the following variables: age, marital st^uSy^ number of dependents, primary 
disability, educational level, employment status, occupational title, VR ser- 
vices received, length of time holding present job, hours of work per week, 
enjoyment derived from present job, means of getting a job, jqb satisfaction, 
work personality, work proficiency, self-acceptance, attitude toward work, 
employment status of spouse, and agreement with spouse on family affairs. 

Variable job satisfaction was measured by the 4-item Hoppock Job 
Satisfaction Blank. This scale is reported to have the split--half reliability 
of .87, corrected by the Spearman-Brown formula to .93 (N = 301, Hoppock, 
1935). The author had administered the Hoppock Job Satisfaction Blank 
and a 31 -item General Job Satisfaction Scale developed by the University 
of Minnesota Industrial Relations Center (Carlson, Dawis, England and 
Lofquist, 1962) to a sample of former clients of West Virginia Rehabilitation 
Center and obtained a very high correlation of .93 (N = 52, p <.001 ) between 
the two job satisfaction measures. Based on this finding and taking into con- 
sideration that it consists of only four items, the Hoppock Blank was selected 
and used in the present study to yield a global measure of job satisfaction of 
the VR 26's who were employed. 
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Variable work personality was measured by the Tseng Work Personality 
^Subscale for the cHeni* This is an 1 1 -item summative rating scale designed to 
yield a global measure of the individual's assessment of his own personal 
quality in a work situation. The 1 1 attributes that constitute the work per- 
sonality measure are the ability to work with others, punctuality, cooper- 
ativeness, self-reliance, appearance, courtesy, motivation, reliability, work 
tolerance, initiative, and attitude toward job (Tseng, 1972c). This subscale 
has the split-half reliability (with the Spearman-Brown correctional .80 
(N = 113) and the internal consistency as measured by Cronbach alpha of 
.86 (N = 113). 

Variable work proficiency was measured by the Tseng Work Proficiency 
Subscale for the client;. It is a 6-item summative rating scale designed to yield 
V a composite score of the individual's assessment of his own proficiency on , 
the job. The six attributes that constitute the work proficiency measure are 
job knowledge, job skill, quality of work, care and operation of equipment, 
observance^f safety practices, and compliance with work rules j[Tseng, 1972c). 
The split-half reliability with the Spearman-Brown correctipn and the internal 
consistency as measured by Cronbach alpha o^t^^is subscale are .89 (N = 1 13) 
and .84 (N = 113), respectively. The total scale/the composite of work per- 
sonality and work proficiency subscales, has the split-half reliability (with the 
Spearman-Brown correction) of .88 (N = 113) and the internal consistency 
(Cronbach alpha) of .89 (N = 1 13). 

Variable^jelf-acceptance and attitude toward work of the client-employees 
were tapped .by the seven-point semantic differential scales (Osgood, Suci, and 
Tannenbaum, 1957) with three bipolar adjectives for each of the two variables. 
The three bipolar adjectives used to measure the clients' self-acceptance are 
happy sad, satisfied-dissatisfied, and optimistic-pessimistic. The three bipolar 
adjectives used to quantify the clients' attitude toward the world of work are 
good-bad, important-unimportant, and interesting-dull. 

/ 

Questionnaire B^ was mailed to tfi^ emfJto^er of the former VR client. 
Variables tapped by this questionnaire h& cliep/s job title, hours of client's . 
work per week, client's work personality, ciTent's work proficiency, client's 
overall perfornr)ance, and importance of VR services on client's performance. 




"\ Variable client's work personality was measured by the Tseng Work 
Personality Subscale for the emplc^er. This is an 1 1 -item summative scale \ 
^d^igned to yield a composite measure of the client's personal quality in a 
work situation as rated by his supervisor. This subscale, as does its counter- 
part for the client-employee, deals with the following eleven attributes: the 
ability to work with others, punctuality, cooperativeness, self-reliance, 
appearance, courtesy, motivatiorv, reliability, work tolerance, initiative, and 
attitude toward job (Tseng, 1972c). The split-half reliability corrected by 
the Spearman-Brown formula an^ internal consistency as measured by 
Cronbach alpha of this subscale are .94 (N = 114) and .91 (N = 1 14), res- 
pectively. 
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Variable client's work proficfency was measured by the Tseng Work Pro- 
ficiency Subscale for the employer. It is a B-item summative rating scale that 
yields a gfobal measure of thextient-employee's work proficiency as rated by 
his supervisor. This subscale, like its counterpart for the client, deals with six 
attributes: job knowledge, job skill, quality of work, care and operation of 
equipment, observance of safety practices, and compliance with work rules 
(Tseng, 1972c). It has the split-half reliability with the Spearman-Brown 
correction of .94 (N = 114) and the internal consistency (Cronbach alpha) 
of .89<N = 114). 

RESULTS 

The total (composite) scale has the split-half reliability (with correction) 
and the internal consistency (Cronbach alpha) of .95 (N = 114) an^ .94 
(N = 114), respectively. 

\ * • * 

Employment Data , 

Ofithe 65 employed clients who responded to Questionnaire A, 55 
(accounHngJlt)r 85%) had full time jobs and 10 (accounting for 15%) were 
working on part-time basis. In terms of hours of Aork per week including 
the time it took to go to and from where these cliifntjiworked, 34 of them 
(accounting for 52%) worked over 40 hours, 28 (accbuntihg for 43%) worked 
from 20 to 40 hours, and 3 (accounting for 5%) work^ less than 20 hours. 

The breakdown of the occupationsof these former clients is as follows: * 
automobile body repairman 1, automobile lot boy 1, auto mechanic 4, 
baby sitter 1, beautician 3, box boy 1, hotel clerk 1, office clerk 3, stock 
clerk 1, community action aide 1, computer operator 1, cook 3, custodian 3, 
damage appraiser 1, bus driver 1, truck driver 4, furnace installer 1, heavy 
equipment operator 1, hospital (nurse) aide 4, kitchen helper 1, laborer 4, 
loan officer 1, mine foreman 1, office helper 1, officer supervisor 1, packer 1, 
practical nurse 1, realtor 1, seamstress/tailor 3, secretary 3, service station 
attendant 1, shoe machine operator 1, social worker 1, stenographer 1, 
teacher 4, waitress 2, and welder 1 . ^ , 

Among these client-employees, 40 (accounting for 62% of them) rfeporte 
that they had held the very jobs over one year, 12 (accounting for 18%) had 
had their jobs from seven months to one year, 5 (accounting for 8%) had held 
the jobs from four to six months, and 6 (accounting for 9%) had held their 
jobs three months or less. There were 2 clients (accounting for 3%) who did 
not respond to this question. 
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Job Performance " .-^ 

Client's work personality (11 attributes) and work proficiency (6 attributes) 
were evaluated by the employers (N = 75) and the clients themselves (N = 65); ' 
In addition, the overall performance of the client was also rated by the respective 
employer. The assessment of these attributes was conducted on a 5-point rating 
scale, with 1 representing the lowest rating and 5 the highest. Table 1 summar- 
izes the result. 



Table 1 » 

Employer and Client Ratings of the Client Work 
Personality and Proficiency Attributes 



Attribute 


X 


Employer 
SD 


N 


: X 


Client 
SD 


N 


Ability to work with others 


4.1 


0.6 


75 


, 4.3 


0.6 


64 


Punctuality 


4.2 


0.7 


75 


4.6 


0.5 


64 


Cooperativeness 


4.3 


0.6 


75 


4.5 


0.7 


64 


Self-reliance 


4.1. 


0.7 


75 


4.5 


0.5 


64 


Appearance 


4.1 


0.6 


75 


4.5 


0.6 


64 


Courtesy 


4.3 


0.7 


75 


4.6 


0.5 


64 


Motivation 


4.0 


0.9 


75 


4.3 


0.8 


64 


Reliability 


4.1 


0.8 


75 


4.6 




b4 


Work Tolerance 


4.0 


0.9 


75 


4.3 


1 0.9 


64 


Initiative - -^^^ - 


3.9 


0.8 


>5 


4.2 


6.8 


64 


.Attitude , \ 


4.1 


0.8 , 


75. 


■ 4.3 


0.9 


63 


Work Personality Corfvppsit^/ 


45.3 


6.2 . 


/^'75^" 


■ "^8.4 


4.6 


62 


Job Knowledge 


4.1 


0.9 


75- 




0.6 


63 


Job Skill ^ • 


4.2 


0.8 ■ 




4.3 


0.7 


63 


Quality of Work * 


4.2 


0.8 


75 


4.4 


0.6 


63 


Care of Equipment 






4.5 


0.5 


63 


Safety Practices 




o.> 


^2 


4.3 


0.7 


59 


Foljowing Shop Rules 


|4.3 


0.7 


')!73 


4.4 


0.6 


59 


Work Proficiency Composite 


25,0 




^^'72 


26.2 


2.9 


59 


Work Personality and Proficiency 


70.3 




72 


74.8 


6.5 


57 


Overall Performance 

( 


4.3 


0.7 


74 
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Employers were considerably satisfied with their disabled employees. This 
was reflected in the relatively high ratings they gave the clients on work person- 
ality (X = 45.3, SD = 6.2, resulted from an 1 1-item 5-point scale), work profici- 
ency (X = 25.0, SD = 3.9, measured by a 6-item 5-point scale), and overall per- 
formance (X = 4.3, SD = 0.7, yielded by a single item 5-point scale). As to the 
ratings of the 17 individual attributes within the work personality and work 
proficiency dimensions, the employers gave their respective client-employees 
an average rating of 4 or above on each of the attributes except "initiative"^* 
which received a mean rating of 3.9. ' * ^ 

To compare the client's self-rating and his employer's rating of the client 
work personality and proficiency, data of the 54 employer-client matched 
pairs were analyzed by th^^^-jest. Table 2 presents the results. * 

Table 2 

Ratings of Client Work Personality and 
Proficiency by Employer-Client Matched Pairs 

Employer Client 
_ Attribute X SD N X SD N t 

Work Personality 46.1 5.7 51 48.2 4.6 51 3.49 ** 
Work Proficiency 25.6 3.6 49 26.3 2.9 49 1.08 

** p<.01 



The client's self-rating on work personality revealed that he tended to over- 
estimate his personal quality when his employer's rating was used as a basis for 
comparison (mean difference 2.1, 51 matched pairs, t = 3.49; p<.01). He was 
mora realistic, however, in rating his own work proficiency level. Work profi- 
ciency ratings given by 49 matched pairs of clients and employers yielded a mean 
difference of 0.7 and a non-significant t value of 1.08. 

f 

^ ^^ob Satisfaction 

*\\ > 

The 4-item 7-point Hoppock Job Satisfaction Blank was responded to by 
. ^5 clients, yielding a mean job satisfaction measure of 20.6 and standard devi- 
ation 3.7. The score of 16 being the neutral (ioint, this finding indicates that 
the disabled employees as a group were moderately satisfied with their job. 

To identify significant correlates of job satisfaction correlation analysis 
wasconducted. The first two columns of Table 3 show the results. 
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Table 3 

Correlates of Job Satisfaction, Self -Acceptance, 
Attitude Toward Work, and Spousal Conformity 



vdridDie 


JS 

r 

1 


N 

1 N 


SA 

f 


N 


ATW 


N 


SC 

X 


N 


Age 


..02 


62 


-.11 


58 


.19 ' 


61 


.01 


29 


Number of Pependents 


-.14 


60 


-.3r 


56 


-.21 


59 


-.31 


29 


Educational Level 


.04 


62 


-.06 


58 


.02 


61 


.29 


29 


Occupational Level 


.20 


62* 


-.21 


58 


-.04 


.61 


-.33 


29 


Length of time holding 
prespni jod 




Rn 

DU 


.uo 


u / 


- in 




- 12 


29 


HniiTQ o'f work npr wppk 


.02 


62 


-.01 


58 


.29* 


61 


.6r** 


29 


Enjoying Work 


42.. 


62 


21* 


58 


.21 


61 


.38 


29 


Rating of VR services 


:.01 


60 


.15 


55 


.06 


58" 


-.08 


27 


Job Satisfaction 


1.Q0, 


62 


34.. 


55 


.11 


58 


• .00 


28 


Self-acceptance 


.34** 


55 


1.00 


'58 


. .35*\ 


58. 


.13 


27 


Attitude toward work 


.11 


58 


.35** 


58 , 


1,00 


61 


.63*** 


29 


Spousal Conforrrtity 


.00 


, 28 


.13 


27 




29 


1.00 


29 


Client rating of 
Work Personality 


.31* 


60 


.34* • 


56 


.39 


59 


.35 ■ 


29 


Client rating of 
Work Proficiency 


-.02 


56 


-.06 


53 


.24 


55 


.12 


27 


Employer rating of 
Work Personality 


.28* 


51 


.25 


.48 


.po 


50 


.06 


25 


'Employer rating of 
Work Proficiency 


.15 


■ 49 


-.01 


46 


-.16 


48 


, -.21- 


24 


Employer rating of , 
Overall Performance 


.09 


51 


* .11 


48 


■ .03 


50 


.10 


25 



•p <.05 
**p<.01 
***p<.001 




9-1 



Variables that had significant correlation with job satisfaction were enjoyment 
derivirig from present job (r = .42, df = 60, p<.01), self-acceptance (r = .34, df = 53, 
p <.01 ), client's rating of his own work personality (r = .31 , df = 58, p <.05)i and 
employer's rating of the client work personality |r = .28, df = 49, p <.05). These 
indicate that the greater the enjoyment the disabled employee gets from his present 
job, the higher the level of self-acceptance of this employee, and the higher the^ 
personality quality of this individual as rated by himself and his employer, the 
higher wodild be his job satisfaction level, and vice versa. 

« ^ 

Self-Acceptance ^ 

A semantic differential instrument, using 3 bipolar adjective 7-point scales 
(sad-happy, dissatisfied-satisfied, pessimistic-optimistic), was employed to yield 
the clients self-acceptance measure. The resultant mean score of 16.7 (SD = 2.3, 
N = 58) indicates that these employed former VR clients as a group were moder- 
ately Fiappy, satisfied, and optimistic and, on average, showed moderately positive 
acceptance of themselves. 

; Correlational analyses were also carried out for the purpose of determining 
significant correlates of self-acceptance. The results are shown in the second two 
columns of Table 3. • . ' ^ 

Self-acceptance was found to correlate negatively with the nup^ber of de- 
pendents (r = -.31, df = 53, p<.05) and positively with variables enjoyment 
derived from present job (r ^ .27, df = 56, p <.05), job satisfaction (r = .34, 
df = 53, p<.01), attitude toward work (r = .35, df = 56, p < .01), and work 
personality as rated by the client-employee himself (r = .34, df = 53, p<.01). 

Attitude Toward Work 

The disabled employee's attitude toward work was measured by another 
semantic differential instrument, consisting of 3 bipolar adjective 7-point scales 
(bad-good, unimportant-important,^ dull-interesting). Responses made by the 
employed former VR clients yielded a mean score of 18.2 and standard deviation 
2.3 (N = 61 ), revealing that they considered "the world of work" to be quite good, 
important, and interesting and, therefore, showed a quite positive attitude toward 
work. 

Correlations between attitude toward work and other variables are present 
in the thIVcf 2 columns of Table 3. Hours of work per week (r = .29, df = 59, 
p <.05), self:9cceptance (r = .35, di^ 56, p <.01 ), spousal conformity (r = .63, 
df''="^75'p'cOpi ), and client's rating of his own worKpersonality (r = .39, 
df = 57, p <.01 ) were positive and significant correlates of the disabled employee's 
attitude toward work. ^ 
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Spousal Conformity 

Married client-employees were asked to indicate their agreement with spouses, 
on matters concerning the family, on a ^oint scale f1 never, 2 very rarely, 3 half 
of the time, 4 most of the time, 5 always agree). The fesultant mean score of 4.0. 
and standard deviations 0.9 (N = 29) indicate that these married former VR clients 
had little problem with their spouses on family affairs. On average, they agreed 
with their spouses mosr of the time on matters concerning the family. 

Correlations between spousal conformity and other variables are shown in 
the last two columns of Table 3. Spousal conformity proved to have a signifi- 
cantly positive association with hours of work per week (r = .61, df = 27, p <.001) 
and attitude toward work (r = .63, df = 27, p <.001). 

Vocational Rehabilitation Services as Viewed by Employed Former Clients 

' \ 

Among the 65 client-employees and 4 self-employed clients, nearly nine out 
of every ten clients indicated that they did not need Vocatipnali Rehabilitation 
to prepare them for their jobs and that they did not need the VR counselor to 
assist them in finding their jobs. Approximately one-half of them warned addi- 
tional services from the VR couqselor. 

When asked "were you able to do this type of work (present job) before you 
contacted Vocational Rehabilitation?" eleven of them (accounting for 16%) 
claimed that they were able to do the work, twelve (accounting fo/ 17%) said 
they had limited ability to do the work, and forty-one clients (accounting for 
59%) reported that they were not able to do the type of work before they con- 
tacted vocational rehabilitation agency. Five clients (accounting for 7%) did not 
give their answers to this question, 

An responding to the^estion "if at some time in the future you need to get 
a job, who should help?" fifty-four clients (accounting for 78%) felt that they 
themselves should find the job, eleven of them (accounting for 16%) felt that 
the VR counselor should find the^ob for them, and one client (accounting for 1%) 
believed that some other agency should get a job for him. 

They were also asked to rate Vocational Rehabilitation services. A great 
majority, fifty-six out of the sixty-nine clients (consisting of 81%), considered 
VR services good and very good. Eight of them (accounting for 10%) gave the 
rating of uncertain, poor, and yjery poor and or not positive about VR services. 
Five clients (accounting for 9%) did riot give their ratings at all. 
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It \s of special interest to note that the positive or negative ratings of VR 
services had no effect at all on the clients' expressed need for additional VR 
services/Of the"ST!tfwUwho gave VR services the ratings of very poor, poor, 
and u^lcertain, 3 expressed their need for additional VR services and 5 felt no 
such need, of the 56 clients who rated VR services good and very good, 28 
indicated need fpr additional VR services and the other 28 expressed no such 
need. These frequencies in the 2 x 2 contingency table yielded a Chi Square 
value of 0.46 which, with 1 degree of freedom, is not statistically significant. 

Vocational Rehabilitation Services as Viewed by Employers 

Employers were asked to respond to the following statement on a 5-point 
scale (1 strongly disagree, 2 disagree, 3 uncertain, 4 agree, 5 strongly agree): 
"the employee training through Vocational Rehabilitation is important to 
his/her job performance." v 

Their responses ranged fron 2 disagree to 5 strongly agree yielding a mean 
score of 3.6 and standard deviation 0.9 (N = 65). The data indicate that em- 
ployers of the disabled workers ss a group do consider vocational rehabilitation 
training important to their employees pei fcnf^^^nce on the job. 

CONCLUSIONS 

On average, the disabled employees who had received vocational rehabil- 
itation services were performing their job satisfactorily, as far as their employers 
were concerned. These former Vocational Rehabilitation clients as a group 
showed moderately high level of satisfaction with their job, moderately high 
degree of self acceptance, and a considerably positive level of attitude toward 
work. 

The disabled employees were asked to rate their own work personality and 
proficiency. Data show that they were more accurate in evaluating their own 
work proficiency than in assessing their own personal quality when their res- 
pective employers ratings were used as the criterion. In fact, they tended to over- 
estimate their work personality. In a previous study the author found a parallel 
m the vocational training setting where vocational rehabilitation trainees self 
evaluation on their work personality and proficiency were compared with the - 
shop instructors assessment (Tseng, 1972c). 

The disabled employees' satisfaction with their job was positively correlated 
with work personality and self-acceptance. There was also a positive association 
between self-acceptance and attitude toward work. In addition, attitude toward 
work had positive correlations with hours of work per week and spousal con- 
formity on family affairs. 
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FOOTNOTES 



^This research was supported in part by West Virginia University Regional 
Rehabilitation Research and Training Center (RT-15), through the Social and 
Rehabilitation Service, Department of Health, Education and Welfare. 



Udelle Friedland for their assistance. Requests for reprints should be sent to 
Dr. M. S. Tseng, Research and Training Center, West Virginia University, 509 
Allen Hall, Morgantown, West Virginia 26506. 

^Interested reader may obtain a copy of Questionnaire A from the author. 

^Interested reader may obtain a copy of Questionnaire B from the author. 



^The author expresses his appreciation to Mr. John M. Panza and Dr. B. 
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